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STOCHASTIC MODELS FOR CHEMICAL REACTIONS: 
I. THEORY OF THE UNIMOLECULAR 
REACTION PROCESS 


ANTHONY F. BARTHOLOMAY* 
HARVARD UNIVERSITY 
BOSTON, MASSACHUSETTS 


A stochastic model for the basic unimolecular chemical reaction A 4» B 
is derived. This model provides a mathematical basis, altogether missing 
in the current kinetic theory, for the analysis of inherent random fluctua- 
tions about the strict concentration-time course prescribed by the exist- 
ing deterministic theory. Limits on the extent of the predicted inherent 
variability are obtained and compared with those usually expected purely 
on the basis of random experimental errors of extraneous origin (not as- 
sociated with the mechanism of reaction). The results support the ex- 
trapolation to chemical systems of a principle of statistical inaccuracy 
for physical systems which has been called by E. Schroedinger ‘‘the 
Vn Law of Physics.” 


1. Introduction. Mathematical models currently used in chemical 
reaction kinetics are ‘‘deterministic’’: once the initial values of 
concentrations of the reactant species are indicated, ordinary 
mathematical functions assign precise concentration values to be 
expected at subsequent times. Large scale fluctuations about 
these predicted values are ascribed usually to extraneous experi- 
mental errors. The statistical method of least squares fitting is 
employed as a smoothing device in such cases in order to obtain 
‘*rate constants.”’ 

Little attention has been paid to the study of fluctuations arising 
‘*inherently’’ in the reaction mechanism itself and not associated 
with random experimental errors. In the case of extremely slow re- 
actions such as radioactive decompositions, which can be followed 
with great precision, the randomness of molecular decompositions 
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cannot be ignored (See Rutherford, Chadwick, Ellis, 1931). L. 
Pauling (1949, p. 335), e.g., in referring to unimolecular reactions 
in general, conjectures that the numbers of molecules predicted for 
various times are not precise; that molecules decompose at random 
at an ‘‘average rate’’ given by the deterministic equation but that a 
‘“‘omall’’ statistical fluctuation from this rate is to be expected. 

How does one go about drawing a line between different orders of 
fluctuations to be expected? The current theory for such reactions 
cannot be used since it predicts no fluctuations whatever. The 
present paper suggests a mathematical rationale for answering this 
and related questions on a purely theoretical basis by constructing 
a stochastic or probabilistic model which may be applied to any 
unimolecular reaction. In constructing this model a correspondence 
principle is invoked which guarantees that the mean value of the 
resulting random function coincides with the ordinary time function 
currently used. The resulting theory may therefore be thought of as 
an extension of the present theories which agree with the current 
deterministic model ‘‘on the average,’’—a situation which is remi- 
niscent of the relationship of modern quantum mechanics to classi- 
cal mechanics. 


2. The mathematical basis. The basic notion of this paper is that 
of a Markoff chain with finitely many states, continuous time param- 
eter, and stationary transition probabilities. This process is simpler 
in many ways than other processes because it makes the assumptions 
(1) that the future state of a system depends only on the present state, 
not on the entire past history; (2) that the probability of a transition 
from one arbitrarily defined ‘‘state’’ of a system to another depends on 
the length of time interval alone, and not on the particular instant at 
which the present state was reached; and (8) that transitions can 
take place at arbitrary times on a continuous time scale, so that the 
evolutionary progress of a system is non-uniform in time. Because 
of these characteristics, the stationary Markoff process seems to 
be well suited not only to chemical reaction kinetics but also to a 
great number of physical and biological kinetic systems (see, e.g., 
Furry, 1937; Feller, 1939, 1950; Arley, 1948; Kendall, 1951; and 
Bartholomay, 1957a,b, 1958a,b). The reader is referred to J. L. 
Doob (1953) for a complete mathematical analysis of such proc- 
esses in general and to an earlier paper on biological growth proc- 
esses published in this journal (Bartholomay, 1958b) for the com- 
plete mathematical treatment of equations similar to those which 
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arose in the present investigation. K. Singer (1953) has used proc- 
esses with somewhat similar structure to explain macroscopic 
fluctuations arising in branching nucleation processes. 

The starting point in the derivation of the ‘‘unimolecular reac- 
tion process’’ is the conception of concentration (expressed in inte- 
gral units of number of molecules per constant volume of reaction 
mixture) as a time-varying random variable, the states or ‘‘values”’ 
at different times being influenced by probability effects. The 
central problem in the mathematical description of this kind of 
stochastic model is the calculation of the matrix of transition prob- 
abilities {p,, (¢)}, where p,, (¢) represents the probability of going 
from a concentration value of i to the value of & <i in time ¢. Once 
these are known, the complete basis for all probability statements 
about the process is at hand. The concentration values 0,1,2,..., 
Mo, where ny is the initial concentration of A in the reaction A “> B, 
define the “Markoff states’? S,,S,,...,S,,, inclassical terminology. 

It has been shown (See Doob, loc. cit., p. 241) that the p,, (¢)’s 
are the solutions of the following ‘‘forward’’ system of differential 
equations: 


Ro 


Pte (2) = Ven Pir (t) +” Vin Pij (t)> (1) 
i#k 


where 2,4 = 0, 1, 2,..., %,), subject to the initial conditions 


1 ( 7; Ds 
oe 0 = = y) 
In this system of equations p’;, (¢) is the time derivative of p,, (7); 
the constant coefficients, the g’s, comprise a ‘‘Q-matrix’’ defined 
as follows: 


FF = Pj (0) > 0 (j # t), (3) 
Wi=-), q;; < 9. (4) 
j#i 


In adapting these equations and relationships to the unimolecular 
reaction, the q’s have first been estimated from theoretical con- 
siderations stemming from the deterministic equations, using a 
method introduced by the author (Bartholomay, 1958b). 
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3. Derivation of the unimolecular stochastic process. The deter- 
ministic mathematical model for the unimolecular reaction A ~> B 
is completely given by the ordinary differential equation 


dn 

= un (5) 

dee ae 
in which the concentration n of A at any time ¢ is treated as an 
ordinary continuous function of time and yp is the rate constant (as- 
suming that reaction conditions are held constant). If ny = (0) 
is the initial concentration of A, then (5) may be integrated to give 


m=n,e P*. (6) 


According to these assumptions then, the approximate number | An| 
of individual molecular transformations taking place in the infini- 
tesimal time from ¢ to (¢ + A¢) is given by 


lAn| =pn At + 0(Ad), (7) 
in which o(A?) is a higher-order infinitesimal, vanishing in the 
limit as At —» 0. Thus, the ratio 


| An| 


=pnAt+ o(At) (8) 


may be interpreted as the probability of a single chemical trans- 
formation from n possible reactant molecules in the time interval 
(2+ At). 

Assuming then that the transformations of individual molecules 
are randomly-occurring independent events, let 


_ | Anl 


p =pAt+o(At) (9) 
be taken as the probability of ‘‘success,’’ and g = 1 — p the prob- 
ability of a failure in a conceptual sequence of Bernoulli trials 
repeated n times (once for each of the n molecules present at time 
t) during the interval (¢, ¢+ Az). These ‘‘trials’’ are independent 
of the location of ¢ on the time scale. According to the binomial 
distribution which governs such events, the probability of & ‘‘suc- 
cesses’’ in n trials is given by 


b (n,k3p) -(;) [wAt+o(At)l* [1-{uAt + o(Ac)f"-*, (10) 
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rn ae 
where 3 is the symbol for the combinations of n objects chosen 


& at a time. Expansion of the right-hand side of (10) gives 


(4) {u At*® + kp*-! At*-! o(At) + 


k(k —1) 
Swe LL 


(10°) 
OeeNE eT LOLA Ee) Ru oot to(aeyiél =f(A?)l, 


where /(A¢) is a polynomial in At with constant coefficients, so 
that 


when & = 1 b(n,1;p) = un At + aa 


IBt 
when & > 2 b(n,k3p) = 0 + o (Ad), SD 


where o(A?¢) represents a polynomial expression in At, each term 
of which contains a power of A¢ greater than 1. Thus, whereas the 
probability of one and only one molecular transformation in this 
time is directly proportional to the concentration n and to the length 
of infinitesimal interval At, (except for terms of higher order in 
At), the probability of more than one such transformation in this 
time contains only higher-order powers of the infinitesimal AZ. 

The preceding considerations may be treated as the inductive 
basis for the following set of axioms which describe the unimolecu- 
lar reaction process in mathematical, probabilistic terms: 

Al. If exactly (n -n,) decompositions have already occurred in 
the time interval (0,f), in the subsequent interval (t,¢+ AZ) the 
probability of a single decomposition of n molecules present at 
time ¢ equals [unAt+o0(Ad)]. The probability of more than one 
such collision in this time equals o (A?). 

A2. The probability parameter » has the dimensions and proper- 
ties of the ordinary rate constant, the reaction proceeding under 
controlled constant conditions of chemical parameter (e.g., temper- 
ature, pressure, volume), rendering » constant. 

A3. Reactant species A and product species B coexist without 
significant interactions of any kind. 

Aj. The reverse reaction B —» A has zero probability. 


This set of axioms implies that the chemical process described 
may be represented mathematically as a Markoff chain of the kind 
discussed in section 2 and leads to the specification of the Q-matrix 
of constants 19,3 in the following way. Assuming, as usual, that 
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the functions {p,; (¢)} satisfy the required differentiability proper- 
ties, each function may be expanded about 0 time into a Taylor- 
Maclaurin series: 


p,; (At) = p;; (0) 1 p,;(0)At+o(A t) (j #7) (12) 
The initial conditions (2) together with this formula imply that 
P,; (At) = 9;;-At+ o(At), (13) 


i.e., neglecting second-order and higher-order terms in Aé, the 
probability of a transition from 7 to j in the time interval of length 
At equals g,;-At. But from axioms Al and A4, p,;(At) has the 
values: 


D,;(At) = pi At+ o(At) (j=7-1), 
= 0(At) (j<t-1), (14) 
= 0 (j > 2). 
Comparison of (14) with (13) and the use of formula (4) show then 
that the Q-matrix elements are 


0 Gj<t-1,7>%) (t= 0, 1, Dieses No)s 
Vij= sue (=2-1), (15) 
-wi (j=2%). 
Appropriate elements of the Q-matrix substituted into (1) yield the 
fundamental set of differential equations of the process: 


Pik (4) =- KD, (t) + w(k + 1) Pik+1 (2) (16) 
for given 7, where 0 <7 < 79, and for all &’s such that & < i. 
This system of ordinary differential equations is transformed into 
a single partial differential equation by use of the ‘‘probability 
generating function’’ (See Bartholomay, 1958b): 


n 


peat. {ry (Oh = d,(8,t)= >* 9 Ag (2) (7) 


k=0 


in which s is an arbitrary variable, with no physical significance, 
introduced purely for mathematical convenience. Differentiating 
#;(8,t) partially with respect to s and ¢ separately and making ap- 
propriate substitutions from (16) gives the fundamental partial dif- 
ferential equation of the system: 


a 
Fy ake ohiid aay a (18) 
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with boundary conditions 


(19 
$,(1,t) = 1. 
The boundary conditions follow, respectively, from initial condi- 
tions (8) and the constraint that for each 7 and all & such that 
O<k<n,, the p(t) define a probability distribution; i.e., 


$; (8,0) = a 


No 
x: P;, (¢) = 1 for all ¢ where each p,, (¢) 2 0. 
k=0 

Equation (18) is a homogeneous, first order, partial differential 
equation to which Lagrange’s method of auxiliary differential equa- 
tions* may be applied, yielding the solution: 


d, (8,t) =E(=1 + e*) + slbeHtt  (¢= 1,2,..., 2,5). (20) 
Expanding the right-hand side, collecting powers of s and compar- 
ing the result with the definition (17) of ¢,(s,¢) gives finally 

P;, (t) = (;) Bohs ter eP)i-e (O<k<t<n,). (21) 


The mean value and variance functions of &, relative to the p,;(t)’s 
defining the distribution of #, are easily calculated to be 


E., (t) = te", (22) 
of (t) = i(e7Ht — e7 3H#), (23) 


This completes the mathematical derivation of the fundamental 
properties of the Markoff model. 


4. Comparison of the stochastic theory with the deterministic 
theory. The transition probability functions given by (21) make it 
possible, given a probable or an exact value of the concentration 
of A at an arbitrary time, to determine the probability that it will 
have a particular value ¢ seconds later. For example, if it is known 
only that a given concentration, say, n=N, (where 0 <N, <1,) 


Ro 
has probability p(N,) where a p(N,) =1, then the probability ¢ 


No=0 
seconds later of finding a concentration value n < Ng is given by 
pat) =P(N)= (N0) emer (t+ etn, (24) 
n 


*See Bartholomay, 1958b, equations (25)-(32) and (60)-(68). 


a 


182 ANTHONY F. BARTHOLOMAY 


On the other hand, if N, is determined as the exact value, then 
p(No)=1 and p(n)=0 (n#N Q) so that in the preceding formula 
the coefficient p(N,) no longer appears. In particular, in the usual 
situation in which the precise value of n is determinable only ini- 
tially as n,, then the probability subsequently of any value n < ny is 


p, (t) = (*o) e HRot (-1 es re ot tag a (25) 


in which case the mean value and standard deviation functions for 
n become, respectively 


E (n,t) = np e~#*, (26) 
a(n,t) = Vn, (eM — e 74). (27) 


But n,e “', with » =, is the precise value of n predicated by the 
deterministic theory. The stochastic model is therefore ‘‘consist- 
ent in the mean’’ with that theory. The progress of a unimolecular 
reaction according to the non-random model is thus seen to furnish 
predictions which hold only ‘‘on the average’’ in a very definite 
sense, according to the stochastic theory (see the reference to 
Pauling’s book quoted earlier) and with a measurable degree of 
dispersion given by (27). 

For comparing the two theories further, it will be convenient to 
“ewrite (25) in the form 


py) = (70) (1 — evmiern (emmys (oe 


the special case when n = n, becomes 
Py, (t) = e~ Bret, (29) 


_ this latter showing how the probability of remaining at n, decays 
‘exponentially with time. If in (28) e~“* is identified with the pa- 
rameter p, and (1 — e~**) with g=1 - >, then for fixed ¢, P, (t) can 
be interpreted as the binomial probability of n successes in n, 
conceptual Bernoulli trials, where p stands for the probability of 
“*success”’ and q for that of ‘‘failure.’’ 

Particularly in the cases of large values for n, the binomial 
form (28) of the transition probability functions can be well approx- 
imated by the Gaussian probability density, 


p (w,t) = (2 2) Fou! (n,t) exp {-j0 7 (n,)[a-E (n,¢)17}, (30) 
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in which the continuous variate z replaces the discrete valued n. 
Relative to this approximation, a region defined by the boundaries 
[E(n,t) + 2o(n,t)] may be constructed in which the points (n,t) ob- 
tained in repeated experimental runs would be most likely to fall 
(with roughly 95% probability). A typical sample curve, correspond- 
ing to a single run, is predicted to be a non-increasing stepwise 
constant curve fluctuating randomly about FE (n,¢) and lying mostly 
inside the region. The regression curve of a large number of re- 
peated sample curves should lie close to E(n,t) which, because of 
the ‘‘mean consistency’’ property of the stochastic process, is 
also the unique time course expected always by the deterministic 
theory (in the absence of error). 

The differences in approach between the deterministic and the 
stochastic theories are summarized in Figure 1 which shows geo- 
metrically the variation of the reaction probability ‘‘force’’ p as a 
function of n and ¢. The resulting 3-dimensional surface will be 
called the ‘‘stochastic reaction surface.’’ Its chief characteristics 
may be seen in terms of families of planar profiles in the planes 
t = constant [using the Gaussian approximation given by (30)] and 
nm = constant. 


FIGURE 1. Stochastic reaction surface for the unimolecular reaction 
process. | 
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The profiles in planes ¢ = K (constant) have been sketched from 
the continuous distribution in z given by equation (30) as a close 
approximation to equation (25). Since the maxima of this family of 
surface curves occur at the mean values of the approximating Gauss- 
ian probability densities p, (K), they correspond to points (n, ex* Sek) 
(where 0 < K <.e) in the (n,t) plane which lie on the deterministic 
curve n =7,e “* shown in that plane. 

In the planes n = c (constant), using the actual probability func- 
tion (25), the profiles have maxima located at points on this same 


1 c 
curve; i.e., ¢=-— log, — for n=c (where 0 <€c<n,). Conse- 
rm No 
quently, while the surface has no relative maxima, there is a sharp 


crest, defined by the maxima of these two families of orthogonal 
profiles, the trace of this crest in the (n,¢) plane being the ordinary 
deterministic concentration curve. 

Thus, the contraction of the total unit area under each profile in 
the family of planes ¢ = K into a height of 1 probability unit above 
the intersection of its projection on the (n,¢) plane with the curve 
(6) represents a mathematical transformation from the stochastic 
onto the deterministic theory. 


5. Some additional properties of the unimolecular stochastic 
process and the stochastic reaction surface. In deriving additional 
properties of this process the transition functions p, (¢) and the re- 
lated mean value E(n,t) and variance functions o?(n,t) will be 
used in order to further emphasize the extension of the determinis- 
tic theory which has been obtained; i.e., n, will be taken as initial 
state 2 as in the latter theory. The results of this section, how- 
ever, apply equally well to any element D;;(t) of the transition 
probability matrix. 

a. Limiting forms. For fixed n the function p,(é) defined by (28) 
may be treated as a regular, analytical function of time. The fol- 
lowing ordinary limits are obtained 


; he 1 (n=n }; 
lim p, (2) “<i (n # no), (31) 
lim 9, (0 =<) * , 2 (32) 


The first of these limits means that as the time interval between 
transitions grows smaller and smaller, the probability of transition 
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becomes negligibly small. The second of these indicates that when 
the allowable time of transition grows infinitely large the proba- 
bility of any specific transition grows negligibly small also, ex- 
cept when n = 0 in which case there is certainty (in the sense of 
probability one). Both values then in (82) point to the ultimate 
extinction of the reactant species A as ¢ grows infinitely large. 
These limiting values which have been checked in this particular 
model .are quantities which would be expected a priori from purely 
mathematical considerations of the stationary Markoff Process.* 
All of the concentration ‘‘states’’ except the zero state are ‘‘tran- 
sient states’’; in such cases the probability of a particular transi- 
tion is expected to approach 0 exponentially fast. 

b. Measure of inherent variability. The expression for the stand- 
ard deviation function o(n,t) [see formula (27)] is a natural one to 
suggest as a measure of the absolute amount of inherent variability of 
dispersion; particularly in view of the connection of the distribu- 
tion function p,(¢) with the normal distribution. The following 
values of this function are of particular interest: 


(a) lim o (n,t) = lim a(n,t) = 0, (33) 
(b) c,..,.(5t) = VN, (34) 


1 . 
the maximal value occurring at time ¢= — log, 2 corresponding to 
U 


the ‘‘half-time’’ of the reaction. Thus the inherent absolute varia- 
bility grows steadily from 0 initially to a maximal value when n, 


n . 
has been reduced to = , receding gradually to zero as the reaction 


approaches completion. According to (34) then, a spread of experi- 
mental values about the mean or deterministic value can reach no. 
This result appears to be consistent with what E. Schroedinger 
(1945) calls the ‘‘\/n Rule’’ (see discussion, section 6). 

The coefficient of variation CV (t) is another statistical concept 
that can be applied to measure the variability, yielding the varia- 
tion relative to the mean or expected value. Applied to the uni- 
molecular process it becomes 

2 


at 
CV (t) = o(t)/E(n,t) = poe : (35) 
No 


*See Doob, 1953, p. 236; and Feller, 1950, p. 324. 
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so that 
lim CV (t) =0, (36) 
t> 
lim CV (t)=<, (37) 
t>co 


the latter limit showing that while the absolute variability is de- 
clining this declines less rapidly than the mean value toward the 
end of reaction run. The relation between these two measures of 
dispersion is shown in Figure 2. 

c. Apparent completion time. The ‘‘apparent’’ completions of 
unimolecular reactions which are generally observed in such cases 
can be interpreted as follows in terms of the stochastic theory. 
If ¢ > 0 is an arbitrarily small positive number, then the time T, 
required to obtain completion with probability equal to (1 - €) is 
determined as the solution of the equation 


Po (t)=(1- e P*yPo=1- €; (38) 


& 


i 2s. 
viz., T,= - — log, {1-(1- )"°]. (39) 
m 


a 
in which (1 - €)"° is the principal nth root of the probability num- 
ber (1 - €). 


6. Discussion. The principal purpose of the present paper has 
been to indicate a manner in which the effect of inherent random 
fluctuations in a chemical reaction can be treated theoretically. 


i log ,? i loge ng t 


FIGURE 2, Standard deviation and coefficient of variation curves of 
the unimolecular reaction process, 
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The solution lies in the construction of a stochastic process show- 
ing how the probabilities of concentration values change with time. 
This contrasts with the deterministic theory which omits probabil- 
ity and gives the rule for the change in concentration as an ordi- 
nary non-random function of time. 

The two approaches are not so far apart as might be imagined. 
The close relationship results from that property imposed on the 
stochastic model which makes the basic deterministic equation (6) 
the stochastic mean value. Random fluctuations about the mean 
value of the proposed stochastic process then amount to fluctua- 
tions about the values predicted by the current theory. 

The magnitude of such deviations may be measured statistically 
in terms of the standard deviation or the coefficient of variation. 
The properties of these measures, as indicated in section 5b, show 
that often the magnitudes of the inherent variations are microscopic 
compared with random divergencies ascribable to extraneous factors 
such as experimental errors. They become macroscopic, however, in 
extremely dilute reactions and in certain epochs of the reaction time. 
The radioactive decomposition process (see Rutherford, Chadwick, 
Ellis, Joc. cit.) is an example of a process in which the orders of mag- 
nitude of the predicted inherent fluctuations called for in this theory 
are realized under conditions controllable to the extent of almost com- 
pletely eliminating experimental error. Another interesting feature is 
the agreement of the measure of dispersion (given by two standard 
deviations) with the order of divergency to be expected between 
predicted and (error-free) observed values in physical laws in gen- 
eral, as pointed out by E. Schroedinger Joc. cit. He states that 
there is a ‘‘\/n Rule of Physics’’: the laws of Physics may be in- 


a 
accurate within a probable relative error of the order of an nm be- 


ing the number of molecules cooperating to bring about the law. In 
the present case the coefficient of variation as a measure of ‘‘rela- 


1 
tive’’ inherent, random dispersion would be ae at maximal devia- 
) 


tion, although in the later stages of the reaction a dispersion factor 
of many multiples of this quantity are possible. 

It should be emphasized that other stochastic models are possi- 
ble. There is, in general, no one-to-one correspondence between 
the class of all stochastic processes and a particular natural proc- 
ess. The one that has been used here has the advantage of great 
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simplicity, which derives from the stationary Markoff characteris- 
tic. In such processes the transition probabilities contain the 
answer to all probability questions which could be raised concern- 
ing the process. In addition to this advantage there are the con-— 
sistencies pointed out above with what has already been assumed 
and tested in dealing with such reactions. The connection is close 
enough in fact to support the statement that the goodness of fit of 
this model to kinetic data is a natural corollary to the goodness of 
fit of the deterministic theory currently employed in the analysis of 
data. 

The ‘‘stochastic reaction surface,’’ which has been defined for 
such reactions, summarizes in geometric fashion the nature of the 
extension in kinetic theory introduced here. In this geometric con- 
text it may be seen to consist of the addition of a third dimension; 
viz., probability, to the concentration and time variables. The 
stochastic surface will in most instances be fairly flat, rising to a 
sharp crest along the intersecting negative exponential cylinder 
which corresponds to the non-random theory. Thus whereas in 
using the deterministic theory a unique value of concentration n is 
taken from a curve which sets up a correspondence between time 
and concentration, according to the stochastic theory, at a given 
time a whole curve of possible values (a section of the surface by 
the plane ¢ = constant) exists. The height of the curve corresponds 
to the probability of occurrence of any concentration at that time. 
The microscopic character of dispersions about expected values in 
reactions with high concentrations n, shows that the existence of 
randomness does not correspond to complete lack of determinism; 
rather that the progress of the reaction is influenced by a ‘‘flow of 
probabilities’? with time in a way which is pictured in this surface. 
The dominating ‘‘reaction force’’ of the deterministic theory is pre- 
served as a strong trend, the crest of the surface. 

Two additional advantages of the mathematical method given 
here are: (1) The generalizability of the method: it has already been 
applied to other types of reactions (Bartholomay, 1957a,b, 1958a), 
and (2) calculation of the rate constant: a new, simple method for 
calculating the rate constant & which results from its identification 
with the basic stochastic parameter will be presented in a sub- 
sequent paper. 

The need for a kinetic analysis of this type will be more acutely 
felt when it becomes possible to analyze in detail some of the bio- 
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chemical reactions taking place in the individual cells of organ- 
isms. For example, the volume of a single gene has been calcu- 
lated to be comparable to the volume of a cube the side of which is 
300 angstroms. As E. Schroedinger (loc. cit.) points out, this can 
span only about 100 or 150 atomic distances in a liquid or solid— 
implying that a gene contains no more than a few million atoms 
which are not all similar nor similarly related. This number ac- 
cording to the stochastic model given here is much too small to 
expect anything like strict determinateness even if all molecules 
were involved in the same reaction (as in a unimolecular decom- 
position). 

There is a universality to these considerations. For example, in 
discussing diffusion-like phenomena E. Schroedinger (loc. cit.) 


writes down the usual partial differential equation — =DV"»p, 


but hastens to point out that while this is a precise mathematical 
formulation its physical exactitude must be challenged in every 
physical application; it will be a very close approximation to real- 
ity only when an enormous number of molecules are involved in the 
diffusion process. As this number grows small, the random devia- 
tion increases, becoming highly significant when that number is 
very small—a characterization which applies also to the unimolec- 
ular reaction process established in the present paper. 
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The random net is modified by the introduction of a finite probability 
that an arbitrarily selected axon is reciprocated. The resulting distribu- 
tion of convergence orders is compared with the corresponding distribu- 
tion for random nets (the Poisson distribution). It is shown that for small 
values of the bias the terms of the distribution near the modal term (within 
& range equal to the square root of the axon density) at first increase as 
the bias increases, while the remaining terms decrease. The modal term 
itself is shown to increase monotonically with the bias throughout the 
whole range of the bias. In some special cases, the general behavior of 
the terms is calculated for the whole range of the bias. Some implica- 
tions are discussed related to the statistical properties of sociograms. 


A net is essentially a directed linear graph. We speak of a net 
if the number of nodes in the graph is so large that it is impossible 
to describe in detail its topological structure. One can then con- 
centrate on the statistical properties of the manifold and so de- 
scribe it in terms of expected values of some parameters or of their 
frequency distributions. 

A convenient point of departure is a ‘‘random net’’ with an ar- 
bitrary but constant number of directed edges issuing from each 
node. The term ‘‘random’’ means that the target of each edge 
(‘‘axon’’ in our terminology, which stems from our earlier interest 
in neural nets) is selected with equal probability from the entire 
population of nodes. 

If the assumption of equiprobability of targets is dropped, we 
have a biased net. In a previous paper (Rapoport, 1957) we listed 
several types of biases of possible importance in the study of real 
nets (for example, sociograms) and have sketched some approaches 
to the mathematical treatment of some of them. In the present paper 
we examine a particular bias, the bias of reciprocity (somewhat 
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inappropriately called ‘‘reflexive bias’”’ in the previous paper), to 
be presently defined. Specifically we will examine the effect of 
the reciprocity bias on the distribution of the “‘orders of conver- 
gence’’ among the nodes. 

A node is of order of convergence (or simply order) #if it is the 
target of k axons. In a random net, the orders are obviously Poisson 
distributed. That is, if the number of axons issuing from each node 
(the axon density) is a, the distribution is given by 

k 
P_(k) = a ee (1) 


This is the probability that an arbitrarily selected node in a 
random net with axon density a is a target of exactly & axons. 

We now introduce the reciprocity bias. Note that, in a random 
net of population N, the probability that a node is a target of an 
arbitrarily selected axon is 1/N. Therefore the probability that a 
particular arbitrarily selected axon is ‘‘reciprocated,”’ i.e., that its 
origin is the target of some axon originating at its target, is 
1-(1-1/N)%. For very large N and fixed a, this becomes in- 
finitesimal and vanishes in the passage to the limit (on which the 
Poisson distribution is based). The reciprocity bias rests on the 
assumption that this probability of being reciprocated is a finite 
probability 2. This probability (0 < 2 < 1) will be referred to as 
the bias. When z =0, the net becomes a random net. In the oppo- 
site extreme, when 2 = 1, a node is certain to receive axons from 
its own a targets and only those, since all the other axons are sent 
reciprocally. Therefore for the case of the largest bias (z = 1), 
the distribution (1) becomes 


P,(@) =1, 
(2) 
Pick) =0 (k#a). 

Remark. Even though all the nets with z = 1, i.e., composed of 
reciprocated axons only (so-called regular linear graphs), have the 
same trivial distribution of convergence orders, their topological 
properties may be widely different for a > 1. We note that for a =1 
complete reciprocity requires that the net fall apart into pairs in 
which each member sends its axon to the other. But for a = 2, the 
net can fall apart into an undetermined number of closed cycles (a 
single closed cycle in the extreme case). For a = 3, the extremes 
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of connectedness and disconnectedness are respectively a surface 
covered with hexagons (a honeycomb) and a collection of com- 
pletely connected quadrilaterals. But also other configurations 
are possible, as shown in Figure 1. Each line in that figure repre- 
sents two axons, one going each way. For a = 6, one may have a 
surface covered with triangles (six edges converging at each point) 
or a three-dimensional cartesian grid, etc. We shall not pursue 
these topological questions in this paper. 


FIGURE 1. Three types of structures in a net with complete reciprocity 
for a = 3. Each line represents a pair of reciprocated axons. 


The General Equation. Consider the a axons issuing from a given 
node. By definition of the reciprocity bias, the probability that 
exactly 7 of these are reciprocated is 


(3) PPS «S(t geet is a) (3) 


The probability that & — 7 additional axons are actually received 
is the same as the probability of receiving & — 7 axons in a random 
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net, since the bias operates by our assumption only on the prob- 
ability of reciprocating a direct connection. However, since the 
fraction z of the total number of axons are reciprocated axons, only 
the fraction (1 — 2) remains ‘‘uncommitted.’’ Therefore the random 
net in question has axon density a(1- 2) instead of a, the axon 
density of the total net. Therefore the probability of receiving 
k — 7 unreciprocated axons will be 


La i aac —acli—% 
rei @ 


The probabilities (3) and (4) being independent, the total prob- 
ability of receiving & axons in a net with reciprocity bias z is 


Min(a,k) : [a(1-)]*~/ 
a j a- G1 =. 
P (k,@) = Ny: (7) z7(1 - 2) 2 Te é ae 
j=0 
‘ oe ‘ amp galad (5) 
en? EX a (Pe ae eee 
2 (i) Be (ej)! 


j=0 


Here ‘‘Min (a,k)’’ denotes a or &, whichever is smaller, or either 
if they are equal. 

We note that for z = 0 the formula reduces to (1), and for z = 1 to 
(2), as of course should be the case. We may also verify that 


a Pi(k,2)=1. To see this, arrange the terms in rows corre- 
k=0 


sponding to the successive values of k (k = 0, 1,...), so that the 
columns represent the values of j from 1 to a. (Where k <a, put 
zeros for values of j > &.) Summing by columns, note that the col- 
umn sums are the successive terms of the binomial distribution (3) 
which in turn sum to unity. 


The distribution of convergences for small values of the bias. 
We can determine the behavior of the expression (5) for small 
values of xe by simply investigating its derivatives with respect to 
xat2=0. For the first derivative we have 


dP, (k, @) a analy 
cewelinhitn line nn OkLINSD convene fle thd: ehh ead 
da d, (kj)! (5) Gap n 
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@ k-j 
Y. dF ea a+k~2j 
(e— pti) * (1 - 2) t= (6, 
j=1 
@ q*7i a 
3 (kj)! (3) wi(1— a)? Ao 3i"1 (a +k = 94), 


j=0 
where the upper limit of the summation » denotes Min(a,k) for 
a#k anda-1fork=a. When we set x = 0, we see that all the 


terms vanish except those corresponding to j = 0 in the first and 
last summations and to j = 1 in the second summation. Therefore 


q*t} a* k 


—a a 
me a ae |<c (7) 


We see that at 2 =0 all the terms of the distribution are sta- 
tionary, and we must examine the second derivative to determine 
their behavior at that point. Proceeding in this way, we obtain for 
the polynomial factor of the derivative 


k~—j+2 k~-jt+i1 
={ = (3) ae : = (3) a ees 
oe | i. af 5 


k-j +1 k-j+i 
a a E - Ts a \ ee =F 
(=p! (3) (m —2j)aiy™ Fe PERV (7) jai lym To 


OP (k, 2) 
Oz 


x=0 


nt 
T= ee 
k-j 
Be ere (6) 
k-j+i 
apt li) ie 2ne 
ae 
ee eg? : : j,,m—-2j-2 
Geapr (;) 29m -24-Dely ’ 


where for brevity we have put y=1-2 andm=a+k and have 
consolidated the summation, it being understood, however, that 
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the limits of summation for each term are such that no negative 
exponent appears in any factor. Setting now z = 0, we obtain 


k+1 k 
qt t2 k 


—— + per ene ee egw (sgl e Prs pore 
k! (tk - 1)! k! (k - 1)! 


a* 7? a*-} qk *} 
aor? (3) - qeepr ee tt) 7 (a+k)- (9) 


a7} a* 


Collecting terms and factoring, we obtain finally 
d7P tke) 


On? 


e %qk-} 


= Ta Toes [{k = (k = a)?] . (10) 


x =0 


The sign of this second derivative is the same as the sign of the 
quantity in the bracket. Therefore P,(k,2z) increases or decreases 
at « = 0 depending on whether k —-(k — a)? >0 or <0. The modal 
term where & = a increases, as is intuitively evident. Solving the 
inequality for & in terms of a, we obtain the range of terms on both 
sides of the modal term which initially increase with the bias, 
even though, except for the modal term, they must eventually de- 
crease when the bias becomes sufficiently large. Solving for & 
gives the limits within which (10) is positive: 


k=a+1/2+ Va+1/4. (11) 


But & is an integer, and in view of (3) we must confine the pres- 
ent investigation to integral values of a. Since (a + 1/4)'”? < a7? + 
1/2, we can write (11) more simply, namely, 


k=atvyva. (12) 


We summarize these results in 

Theorem 1. As the reciprocity bias begins to increase from 
zero, the terms of the distribution of orders k begin to increase for 
k £a+Vaandk2a- \Vaand to decrease for the remaining values 
of k. 

This result does not tell the whole story even of this qualitative 
behavior of the convergence orders. We know that ultimately, i.e., 
for z = 1, all the terms vanish except the modal term, & = a. There- 
fore for values of 2 sufficiently large, all the terms except the 
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modal term must decrease as «@ increases. The following ques- 
tions are still unanswered: 

1. Do the terms corresponding to | & - a| > Vk, i.e., those which 
initially decrease, continue to decrease monotonically as 2 in- 
creases from 0 to 1? 

2. Is the maximum, which we now know exists for the remaining 
terms excluding the modal term, the only maximum; that is, do those 
terms when they have started to decrease continue to do so? 

Answers to these questions are inherent in the properties of the 
polynomial in the braces of expression (6). Consider all such 
polynomials for various values of a and & as a two-parameter 
family of polynomials in z. If for a given pair of values (a,k) a 
polynomial of this family can be shown to have no roots in the open 
interval (0 < z < 1), then the corresponding term of the distribution 
behaves monotonically in this interval. If such a polynomial can 
be shown to have a single real root in this interval, then the corre- 
sponding term will have a single extremum, etc. It can be shown 
that after factoring out the largest power of (1 — z) from these poly- 
nomials we obtain polynomials of degree 24 +1 when & <a, of 
degree 2a + 1 when a <k, and of degree 2a whena=k. We know 
that one of the roots is always at x =0. This leaves polynomials 
of degrees 2k, 2a, or 2a-—1. Therefore for a > 2, & > 2 the prob- 
lem of obtaining the roots directly is not simple. We have been 
able, however, to investigate the behavior of the modal term (k = a) 
for arbitrary a for the entire range of the bias. 


The behavior of the modal term. 

Theorem 2. The modal term (k = a) increases monotonically as 
the bias increases from zero to one. 

If a = k, the polynomial in question becomes 


a. q@~it} : 
ai (f) ef - ate? + 
ee 


a ati _ ; é ‘ 
apr (eta ore? - (13 
a —j)! 
jJ= 


£4 (a-j)! \3 : 
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Consider (13) as a polynomial in x whose coefficients involve 
powers of (1 - 2). 

Let us write down the coefficient of 2’ for 0<j<a. In this 
range, factors from all three summations will be involved, and we 
see from (13) this coefficient to be 


a-j+t a-j ‘ 
a (3) (1 — 2)2@-) 9 (3) (a - j)(1 — w)?P 14 


(a~j)! \J (a-—j)! \J 
(14) 
ast t et a . _ p\2(a—-f)—2 
—— (;21)6+ 00 2) ; ’ 
and upon factoring 
a-j-1 
z . 7) (41 — 2)20¢- 7-2 [g2(1 ~2)? - 2a(a - f(1-2) + 
(a-j)! \J 
(15) 


a-j-l 
(a DM = H— (G) G- ay P= faa) - (@ - fl? 20. 
(a-j)! \J 

Thus all the terms involving x’ (0 <j < a) are non-negative. The 
coefficient of 2% involves a factor only from the first summation 
and therefore is also non-negative. Therefore expression (13) is a 
summation of non-negative terms only. But this means that 
dP (a,x)/d& is non-negative, hence P_ (a,x) increases monotoni- 
cally with z and our theorem is proved. 

The question concerning the remaining terms of the distribution 
remains open. We can, however, prove some special results. 


The cases a= 1andk =1. 

Theorem 8. /fa = 1, all the terms decrease as x increases through- 
out the interval (0<x <1) except the modal term and the term 
corresponding to k = 2, which has a single maximum. 

Proof, For this case (5) reduces to 


67 O() —~a) ee (hie); 


aes (1 -a)**! CP (16) 
Gl ey AES re he —$——_____. 
e | kl + (k - 1)! ’ (k 2 1). 
For k = 0, we have 
dP, (0, : 
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18 
(1-2)? + ka(1-a) +k(1-2) - (k+1)(1-2)?-k(k -1)a). ve 
The polynomial in brackets reduces to 
—7° +227(1-k)+2(-k? + 3k-1), (19) 
which has roots at z = 0 and at 
e@=1-—-kt+ Vk. (20) 


The only root in the open interval (0 < 2< 1) is at e = V2 -1 for 
k =2. This proves the theorem. 

Theorem 4. For all a> 2, the terms corresponding to k = 1 de- 
crease monotonically as x increases. Fora = 2, there is a single 
maximum atx = 1/2. The term k = 0 decreases monotonically. 

Proof. For k =0 


P(0 52). e551 —a)$ , (21) 
a = -re *3-*q(1—2)2-!<0 (O<2<1). (22) 
For &=1, a> 1, 
P (1,2) = e~*-” [(1 - 2)**! + ae(1 - 2)?~"], (23) 
dP, (1,2) = 


rs) ae *-*) (1 — x)?-? 2[-az? + 2(a-1)-(a-2)]. (24) 
2 


The roots of the polynomial are at 
w= = (a-14 y-803 + 6a+ 1). (25) 
a 


For a = 2, the only. root between 0 and 1 is at e = 1/2. There 
are no roots for any other integral value of a > 1. 

At the expense of considerable computing labor, we can prove 
corresponding theorems for a = 2 (& arbitrary) and k = 2 (a arbitrary). 
Thus no counter-example has been found to the conjecture that the 
terms which start to decrease continue to decrease monotonically 
and the terms which start to increase have a single maximum (ex- 
cept the modal term). Rigorous proof is lacking, however, for the 


general case. 
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Applications to a statistical theory of soctograms. The most 
direct applications of the foregoing are to sociograms of large popu- 
lations which are easy to study empirically. Reciprocity bias cer- 
tainly operates in such populations with respect to, say, the friend- 
ship relations. Indeed, in the only large sociogram examined by 
the author (some 250 elementary school children) the reciprocity 
bias was found to be actually 1/3 on the ‘‘best friend’’ level, i.e., 
of the 250 axons (a = 1) 86 were reciprocated. If the reciprocity 
bias is the principal bias in the net, it ought to account for any 
departure from the Poisson distribution of the convergence orders. 
With 2 = 1/2,the distribution ought to be by our equation (2) the 
following in ascending orders: 0.30, 0.45, 0.19, 0.04, 0.006.... 
The Poisson distribution gives the following values is 0.87, 0.387, 
0.18, 0.06, 0.015,.... That is to say, in a random net sociogram, 
in which each person names one friend, 37% of the population can 
be expected to be not named at all, 37% to be named just once, 18% 
just twice, etc. But in a net where half the namings are recipro- 
cated, only 30% can be expected not to be named, 45% to be named 
once, 19% twice etc. Similar results can be computed for any value 
of the bias from our equation (5). In any real sociogram the frac- 
tion of namings reciprocated can be directly determined empiri- 
cally. Our model therefore predicts (without any free parameters) 
the expected fractions of the population to be named not at all, 
once, twice, etc. Before making any empirical comparison, there 
is a statistical question to decide of whether the theoretical dis- 
crepancy is sufficient to be detected above the ‘‘noise’’ of sta- 
tistical fluctuation for a given magnitude of the population. In 
principle, however, such comparisons can be made, and they be- 
come the more significant the larger the population, 

However the reciprocity bias, as here defined, may not be the 
only bias operating. As idealized here, the reciprocity bias op- 
erates only on direct connections. It is to be expected that ina 
sociogram it operates also on connections between individuals 
separated by a small number of ‘‘removes,’’ that is, the reciprocity 
bias becomes akin to the general social distance bias, treated 
theoretically by rather crude approximations elsewhere (Rapoport, 
1953a,b). The treatment here is more rigorous but is confined to 
pairs of individuals directly connected and to the examination of 
the convergence orders. 
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Another bias which may be operating in a social net is a “‘popu- 
larity bias’’ (called ‘‘force field bias’? in a previous paper), An 
interesting thing about this bias (to be examined in relation to con- 
vergence orders in our next paper) is that its effects are opposite 
to those of the reciprocity bias: it tends to depress the modal term 
and its neighbors and thus to flatten the distribution instead of 
making it sharper, as the reciprocity bias does. In an actual popu- 
lation, therefore, the two biases may cancel each other; the con- 
vergence orders may not depart significantly from those in a ran- 
dom net, and yet the net may be by no means random. Other sta- 
tistics than the convergence orders must then be examined. Their 
behavior may help us to ‘‘disentangle’’ the separate biases and 
thus to learn something about the statistical structure of the socio- 
metric relations in the population. Such a program calls for a fur- 
ther development of the theory of biased nets. 
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As far as the potential distribution outside the current generators is 
concerned, any current source distribution may be replaced by a suitable 
collection of multipoles. If these current generators lie close to the geo- 
metrical center of the volume conductor, a central dipole is a good ap- 
proximation for potentials at surface points which are at considerable 
distances from the center. For better accuracy and for points close to 
the center, additional singularities such as a central quadrupole, a cen- 
tral octopole, etc., should be included. Potential expressions due to 
such multipoles in a spherical conductor can be obtained in closed forms 
by means of the ‘‘interior sphere theorem.’’ This paper presents a method 
for determining successively better multipole representations of the cur- 
rent generators in a homogeneous conducting sphere by measuring sur- 
face potentials at a successively increasing number of points. It is 
shown that Einthoven’s triangle and Wilson’s tetrahedron in the theory of 
electrocardiography are first and second approximations of this method. 
This concept also applies to conductors of other shapes. 


Multipole expansion of any potential in an infinite domain. Let 
P (#5, Yo» 29) be a current source density distribution which is zero 
outside the domain r < a). The potential at a point outside of this 
domain is given by the following series (see, for example, Morse 
and Feshbach, 1953, p. 1277): 


iL wae 
x 
(lee TR tk! (n-1-h)! 
{J Jo gaa eae as OG) deyAyodto} x (1) 


an 1 
daldykagn—t—F _ 3 for r> oe 
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This series shows that all that we can find out about the current 
distribution p in r < a) by measurements of potentials outside r = a 
are the properties represented by the magnitudes of the following 


various integrals: 
q= [[fe dz dy )d2,, 
V 


D, = [ff % p dz,dy,d2,, 
V 
Dy - {ff Yo pda dy,d2,, 
V 
D, - |{[eo pde,dy dz, 
V 
Qax = [{[ #50 deodyodey, 
V 
Qyy = [[[ vee deodvode, 
Vv 
Q..7 [[[#Bedsodysdey, 
V 
ce zz [[[ov0e deodyade, re Qyx 
V 
Vy. - {[[v020» deodyodey = Qos, 
V 
Qa. ~ [[f 2020p deodyade, =Q,.; 
Vv 


Lee “fff 25 p daydy)d2o, 
V 


(2) 
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If r is appreciably larger than a,, the potentials (ziven by the 
1 
derivatives of Fe for the higher values of n become so small as to 


be impossible of measurement, and all we can obtain are the values 
of the integrals in equations (2) for n less than some finite value 
that becomes smaller with larger r which is the distance at which 
we measure the potential. 

In equation (1) the term corresponding to n = 0 is the potential of 
a source at the origin of strength g whose unit potential is 

reir (3) 
r 
The first of equations (2) shows that qg is exactly the total current 
inft<da,. Fora volume conductor with insulated body surface there 
is no surface current across the boundary, hence g=0. This is 
the case in the theory of electrocardiography. 

There are three terms for n = 1 in equation (1). They are poten- 
tials of three components D,, D,, and D, of a vector representing 
a dipole at the origin. The potentials due to the unit components 
of the dipole are 


sao (a4, (4) 


The nine terms of the type for n = 2 in equation (1) are the poten- 


tials of nine components Q,,,Q, : Vee: Quy Qyer Qyu Vey Q.,) and 
Q,., of a dyadic representing a quadrupole at the origin. The po- 
tentials due to the unit components of the quadrupole are 


ach RS ae eee 
fb) =~ — | -)= —7 - a 
e 2 da? \r 

2 2 
LEC ak rt Pace (5) 
0 2 dy? 
(ee) 1p" (“) Bras ae = 
0 = a | Sa) a a Sena 
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2 
$2 ah Ian d (=) - 22 
e e 2 dvdy \r 215 
2 
fh¥®? eat bf? = 1 0 (=) fe ghis3 (5) 
3 2 dyd2\r af (cont.) 
1 
2 


pith ein $2 = 


Since 9,,=4,,, 9,, =%:y) Q,. = %,,) it is a symmetric dyadic 
and the nine terms can be combined into six terms. 

The 27 terms of the type for n = 3.in eee, (1) are the potentials 
of 27 components Divat?s Pref iets of a triadic representing 
an octopole at the origin. The RS rae “due to the unit components 
of the octopole are 

1 0°: /Aeinbe tress 
pages? aes 


6 de® \r/ Or? D5 ?°°* 


8 2 
b (**% = bfy*” = CP Lek a sans = ae 2 eer --- ?(6) 


6 da? dy Ort 275? 
8 
b(t" = pies Se ae enzo (2)- 5 ays 
6 dvdyda\r Qe" 


Since 0, wae aU = O sys) etc., it is a symmetric triadic and the 
27 terms can be combined into 10 terms. 


For larger values of n there are tetradics,..., polyadics repre- 
senting 2 *~poles,..., 2"=poles at the origin. For a discussion 
on multipoles and graphical arrangements of dipoles and quadru- 
poles see, for example, Morse and Feshbach (1953), page 1281. 

Thus the potential of equation (1) can be expressed as follows: 


Go = 7h +D, $5" +D, b6 +D, d§ + Q,, b6%* + 
Qyy bo" + OGG +20, G4 20, SG (7) 
aC ¢o7* Ler rae 5 et 
where q = 0 for problems in electrocardiography. 


Disturbance potential due to the presence of a sphere. Accord- 
ing to the ‘‘interior sphere theorem’? of Ludford, Martinek and Yeh 
(1955), the disturbance potential $,(r) due to the presence of a 
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sphere r= a> a, can be expressed in closed form in terms of the 
original potential ¢, (r) = 4, (7,9, ) in which g=0 for the case 
considered. For the boundary condition 


= (bo +1) =0 on r= a, (8) 


2 
Vitebe 0 


Let us evaluate the component disturbance potentials ¢ {*, 4{”, 
. by means of equation (9). We have from equations (4) 


this disturbance potential reads 


81) = b1(40,9)= 2 b9(— Shep 


ar 


2 sin 6cos 9 


(x) be. ice! Sof Sie Pehl RAE SNS. 
SOO (10) 
Hence 
in 6 2 rp? #2 sin 6 cos 
sire t Fem toe 27 seresinicscosey 
at ar AG 
(11) 
2 2@ ae 2a 
moa a L-2J4, raoe ss 
Similarly, we have 
2 22 
$ (pr) = = $iP()= =. (12) 
Consider now 
32? a 3 sin? 6 cos? 9-1 
 (**) (1) Ree RR a TY ee (13) 
0 275 Qr 2r 
Then 
3 2 oe 
5 (1) a (3 sin* 0 cos” Y San 
2 a8 
co  9(3 sin? 6 cos? p-1 3? ~ r? 
ar r 24 


— 
= a e 


37 ra ay Za2—22 3e2—-72 38(827 - £7) 
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Similarly, 
3 (3 y? — 1?) Pet 3(3 2? — r?) 
$17) = nn ae Oe ee 
For the term 
3ay 8 sin? Ocos 9 sin? 
ag ger(y = See ema (16) 
we have 
a 8r* sin? 6cos 9 sin 
2p 1% (r) = SS IST SERIE 
2 pr  3r° sin? 6 cos 9 sin 32 
=i) pai sen Sih 73 8 (17) 
ar J, A a 
6 ay ea Bey Bay Yay 
ie ers Serer aes Fae Ft 
and similarly 
Cy¥2)(p) = Sys 9 (22) (7) = 9 30 (18) 
ott a ee 


The process can be carried on for terms of higher values of n. 
The total disturbance potential is then 


$1 =D, 81? +D, b+, dP + SEP +, SPP + Cag) 
Q6,9 $77 +20, b{8 420, A697 420, df94+.... 


Determination of the current generators by surface measurement. 
Combining equations (7) and (19) we have the total potential at any 
point (a, y, 2) in the spherical volume conductor 


$(,Y, 2) = bo (a), 2) + 4 (#4, 2) = Di [of*? + Sf] + 
Bey? + $<” + D, [¢{?? + db (7) + Q. [6 0°” + d (**)] + 
Q,, (bg? ?? + oi be Om fp et etary Rae (20) 
2Q.,[66*” + db #7] +2Q,, [667+ op {%?)] “ 
2Q,,[6f7 + O67 14.... 


where the expression in each bracket is a function of the coordi- 
nates x, y, and 2 of this point and D,, Dyyeees Qyyyeee are Con- 
stants to be determined. 
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Equations (4), (5), and (6) show that at a large distance from the 
center the unit potentials due to higher-order poles are negligible 
as compared with the lower-order ones. The total potential may 
be assumed to be due to a dipole only and equation (20) then con- 
tains merely the first three terms on the right-hand side. The prob- 
lem is to determine the dipole components D,, D,, and D,. Sup- 
pose the potential difference between the points P,(2,,y,,2,) and 
Py {%5,Yq,2g) is measured. Then equation (20) gives one linear 
algebraic equation for three unknowns D_, Dy, and D_: 


¢ (P3) ia d (P;) = D, (o5*(P.) <= A abl aFy | su Gree.) “igh capned (aay) aT: 
D (pg? (P.) $67 (P}) + bf (P,)- dfP(P, + (21) 
D, (467? (P,) - ies, US ca ie Uta nial Pe(PHE 


Three such equations are necessary to determine the three un- 
knowns uniquely. Hence we need the measurements of potential 
differences between the point P, and a third point P, (#4, 75, 23), 
and between P, and a fourth point P,(#,,y,,2,). Thus potential 
measurements at four points determine uniquely a central dipole of 
components D,, D,, and D, as the sole current generator. 

Now for better accuracy and for points close to the center, the 
contributions due to the quadrupole should be taken into account. 
Equation (20) contains the first 9 terms on the right-hand side. 
When the potential difference between the points P, and P, is 
measured, equation (20) gives one linear algebraic equation for 9 
unknowns D,, D,, D,, Q os Qyy 9.29 Vey: Qy2 Q,,: Nine such 
equations are necessary to determine uniquely the 9 unknowns. 
Hence we need potential measurements at 10 points which uniquely 
determine a central dipole of components D,, D,, and D, and a 
central symmetric quadrupole of components Q, ,, Oey) Qs.) Qey = 
249 9,,=9,,> and Q,, =@,, 8 the current generators. 

This process can be carried out to any desirable accuracy by 
taking potential measurements at an increasing number of points. 
For instance, if an octopole is added as the current generator, 
there will be 19 unknowns and measurements will be necessary at 
20 points. 


The solution of simultaneous linear algebraic equations. The 
solution of m non-homogeneous linear algebraic equations in m un- 
knowns can be most conveniently obtained by Cramer’s rule. Con- 
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sider the set of m equations in the unknowns X,, X,,..., X,,: 


Cin gy cue Agbives = Fata X =F; 


Ca 1X, + CagXq teeet Com Xm = Has (22) 
Ct XqF Cg Xo. t+ 0c t Cum Xm iene 
If the determinant of the system 
oa ice Go See 
INES Vin pote, Meh oe? kee a «0, (23) 
Cw Cn be Cam 
the system of equations (22) has a unique solution given by 
AS i A. 
Xj meagre Ag aera Me =e (24) 


where A. is the determinant formed by replacing the elements 
Cre» Cogreees Cm, Of the sth column of A by &k,, kg,..., & 
respectively. 

For example, let us consider the case of a dipole as the sole 
current generator. Then measurements of potential differences at 
four points give three simultaneous equations: 


C110, + CygD, + C139, = hy, 


m 


C,,D, + CogD, + Co,D, =k, 
C,,D, + Cao), + Ca3D, =k, 


(25) 


where 


= $5? (P,) — 697 (P;) + $f*(P,) - df” (P,), 
a lan Se bias ¥ olgmeel COC OU OEE OR Ee See eee TER (28) 


eeeeoeveveeeeee eevee eee eeeeeeneeeeeeeee eeeeeeeeveee 


aa Paka (ah ‘"e bP, ) + d ((P,) ae bf (Py: 


are given by the coordinates of the chosen points P,, P,, P,, and P, 
and 


ky me $(P,) - f(P,), 
ky = (Ps) - $(P,), (27) 
ss (Py) = (Py), 


are given by the potential differences measured. 
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The points should be so chosen that 


Cry CQ C43 
A= 105; Cog Og, | # 0. (28) 
C31 C32 C33 


Then the unique solution is given by 


ki Cig Cy C1y hy Cy, C11 Cig hy 

ha Cag Cos Cai ho Cog Co1 Con ko 
. Ky Cao Cas nee Ca1 Ks Cag _ 1Cgy Cag kg 
s A coer A mgt Ss A 


(29) 

Eintho ven triangle as the first approximation. Let the points R, 
L, and F be the apices of Einthoven’s equilateral triangle in- 
scribed in the great circle represented by the intersection of the 
XY plane with the spherical surface r=a. Take as X-axis the 
line parallel to RL positive to the left, as Y-axis the perpendicu- 
lar bisector of RL which passes through F positive downward, and 
as Z-axis the line perpendicular to the XY plane positive to the 
rear. Then the points Rf, L, and F have the following coordinates: 


a Cee | 3 -1 
p= P, (a, a0), bP, (Sa, 00), 
F =P, (0, 4,0). 


(30) 


Einthoven considers the current generator as a central dipole in 
the XY plane, i.e., a dipole with D, = 0. Hence only two unknowns 
D, and D, are to be determined. Therefore measurements at three 
points are sufficient to determine the dipole uniquely. The two 
simultaneous equations are 


jl ae ea (31) 
C,,D, + CoD, = ka, 
Lice get SAUNA CAA Die CBR a 


and from equations (26), (4), (11), and (12) 
C11 BE? (Py) — GE (P,) + 6? (Pa) — B17? (Py) = 


V3 J3 (33) 
—a —- —d@q — 
2 2 M30 =yo0s—-S/ 3 

a ee ete ght a 
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Cig = $5” (Pq) - 9” (P,) + $17? (Py) — 61° (P,) = 


a a 
2 2 ye -a@ —@ =a 
ha a® a® a? 
Gop = G6 (Psy 6? (P,) + of (Ps) - i (P,) = 
v3 (33) 
a == 
0 2 0- -V3a 3/38 (cont.) 


Coa = $47 (Py) - $97 (P,) + 677 (P,) - $1" (P,) = 


a a 


bo 
& 
Q 
Ihe 


a 
er | 


Equations (31) become 


3/3 
a2 D,+9-D, = (Lead) I, 
a 
(34) 
3/3 9 
9 a2 D, + oq? Py = (Lead) Il. 
The first equation gives 
2 
a 
D, = ——I. 35 


Substituting this into the second equation we have 
enn Ge | 36 
e736 ib ae) 


These check witn the results obtained by means of the familiar 
graphical method. The magnitude of the dipole vector is then 


pa AS ae ea = ey 4 hak 1 ; 
D =D +d? = \/—194 —-(n--1) = 


ae I? * ar Ill)? a” Ring - 
3y3 V car Y= 35 (Bin oven’s E), 


(37) 
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where the third lead, III, satisfying Einthoven’s law 
Il = II - I (38) 


has been introduced. 
It can be observed that 


Vr = [66 (P,) ae pre*(P.)ID- + [4(”(P,) fe ${?(P,)ID, = 
a ote ‘ het tea | ~3/3 3 
gat * gt **\pat* a8] oat sage 
= [6§7?(P,) + ${* (P,)ID, + [$8 (Pa) + $ £7 (P,)IDy 

ee ES 25 = 33 3 (39) 
a(S + Bhp +( = «So, - oq2 ea ga 


Vz = [bo%? (Ps) + $ §*(P,)ID, + [dg7 (Ps) + Hf” (P,)ID, 


1 2 3 
= (0+ 00, + (5+ 4)D,= 4, 


tl 


Hence 
Va +V, +Vp, =0 (40) 
for any dipole of components D, and D,, (D, = 0). 


Wilson tetrahedron as the second approximation. Let R, L, F, 
and B be the apices of Wilson’s equilateral tetrahedron inscribed 
within the sphere r = a (Wilson, Johnston and Kossmann, 1947, p. 
602). Take as X-axis the line parallel to RL, positive to the left; 
as Y-axis the line parallel to the perpendicular bisector of RL 
which passes through F, positive downward; and as Z-axis the 
line OB, positive to the rear. Then the four apices have the fol- 
lowing coordinates: 


R= Hee, Ser.) ey | Rate = 


3 3 3 3 3 
9/2a -a 
3 ’ o) B = P, (0,0, a). 


(41) 


Wilson considers a spatial central dipole as the sole current 
generator. Three unknowns D,, D,, and D, are to be determined. 
Hence measurements at four bots, are sufficient to determine the 
dipole uniquely. The three simultaneous equations are given by 
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equations (25). It can be shown by equations similar to equations 
(39) that 


Vp +V, +Ve+Vp =90, (42) 


for any dipole of components D,, D,, and D,. Hence instead of 
measuring potential differences between two points, Wilson sug- 
gested direct measurements of potentials V,, V,, V,;, and Vp by 
leading to the electrodes at the apices from the so-called ‘‘central 
terminal’’ connected through equal resistance to the electrodes at 
R,L,F, and B. Only three of these four measurements are neces- 
sary in equations (25). Let us take 


k,=V,, kag=Vp, hy =Vp- (43) 
Then the corresponding coefficients in equations (25) are 


6 
C11 = 99% (Pa) + {* (Po) -S, 


~/2 
ag oo (Ps) M2 gor(Py =e, 


ae cath) = pie (Fa) = 


oe? 
C41 = $4* (Ps) + H{*?(P,) = 0, 
2/2 
Cog = $67 (P,) + 68? (P,) = Pte. (44) 
(z) (z) 1 
Cog =o" (P3)+ 9} Oy) =3 a 


051 = $f (P,) + S(P,) = 0, 
Cag 7 dg (P 2) 25 ot”? (P,) =0, 


3 
Cag $67 (P,) + b{*(P,) = a 


From equation (28) we have 


V6 -v2 -1 
12/3 
Az = 0 2/2 el tres #0. (45) 
a a 
0 0 3 
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Hence from equations (29) 


vows = 
pee eekly Spee aetinih wie tn pe srnn g 
c 12/3 y " H “i0V5 | pa Ba Va)s 
B 
aa - 
0 eal y. errs 
EE) i fe 4 Eo (8V,+Vp)s (46) 
B 
a? V6 -/2 V, a? 
D.= eae oy | ae 
B 


The magnitude of the dipole vector is then 
ra ori a ere p WEP 
D=\D; Sap + D, = 


Qa 1 By . 5 a = 
aA EC oor. L+3V_,+3V,)° + (3V, + V5) peepee 
V= (8 (V, - Vg)? + (Vp Vg) + (Vp -V,)H1+V2= (47) 
il 
\ G = Va)? + = Vp - Va) + Vp -v,)!°|+ V3 = 


BETS 


Il 
Qo | 


00 | oo) 


[8 =] ©], 


oo | 08 
Ry 


which checks with the results obtained by Wilson. 

Similarly, Grant’s isosceles tetrahedron (see, for example, Sodi- 
Pallares and Calder, 1956, p. 123) is also a second approximation 
of this model by taking P,, P, and P, of Einthoven’s triangle and 
P,, of Wilson’s tetrahedron. 


Conclusions. A method is presented for determining successively 
better multipole representations of the current generators in a 
homogeneous conducting sphere by measuring surface potentials at 
successively increasing numbers of points. For a chosen frame- 
work, i.e., for chosen points P,, P,, etc., most of the numerical 
computation can be carried out once for all before the measure- 
ments used for the diagnosis. Thus the determinant A of equation 
(23) and the elements of each of A,, A,,... of equations (24) ex- 
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cept those in one of the columns are known before the measure- 
ments. Hence actual computation at the time of diagnosis amounts 
only to the evaluation of the determinants A,, A,,..., A,. 

For bodies of non-spherical shapes the formulations hold ap- 
proximately in the sense that the disturbance potentials are ap- 
proximately evaluated according to a spherical boundary. Hence 
the measuring points P,, P,,... can be taken on the actual body 
surface and need not necessarily be on a spherical surface. 

A dipole in a plane (as Einthoven’s triangle) and a dipole in the 
space (as Wilson’s and Grant’s tetrahedrons) are first and second 
approximations of the method. The next approximations are addi- 
tions of a quadrupole, an octopole, etc. These higher-order singu- 
larities render more refined aspects of the current distributions. 
Their clinical significance is believed to be a worthwhile study. 


The authors wish to thank Dr. J. Watt, Dr. K. S. Cole, Dr. R. P. 
Grant, Dr. E. Darby, and Dr. M. Goldstein of the National Insti- 
tutes of Health for their encouragement during the course of this 
research. 
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Some 5,000 dorsal root axons innervate 100,000 hairs on the rabbit 
ear, and each hair is innervated by 4-6 axons. Assuming predetermined 
cause, it is shown that this biological information system transmits in- 
formation specifying locality and force of stimulation in such a way that 
error is effectively controlled for minimal natural stimuli. Under con- 
ditions of maximal stimulation, however, absolute representation of lo- 
cality of all stimulated hairs is not achieved. This limitation is probably 
of little importance for the animal and is compensated for by the large 
reduction in volume of transmission lines. The biological system is 
compared with von Neumann’s theoretical model for the control of error 
in automata by multiplexing. 


Given the requirements that a communication system shall trans- 
mit information specifying completely (1) cause (e.g., modality), 
(2) place, and (8) intensity of stimulation (e.g., force), ‘the sug- 
gestion which is at first sight natural and almost intuitive is to 
arrange a transducing device sensitive to only one kind of physi- 
cal agent and joined without exterior connection by a single line 
to a receiving device. In such a system any activity at all can 
have occurred only at the given point and can have been caused 
only by a particular kind of stimulus. Hence both locality and 
cause are predetermined. Force of stimulation is then simply 
represented by some function of frequency of response. Such an 
argument is so compelling that explanations of the mechanism of 
cutaneous sensibility have long invoked a theory of predetermined 
cause (Miller’s doctrine of “specific nerve energy’’) and have 
inferred the existence of predetermined locality. Actually the 
only proved part of such a thesis was the demonstration by Adrian 
and others that intensity of stimulation can be represented by a 
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function of frequency of response of the end-organ. Sufficient 
evidence has accumulated recently to show that, in respect to 
cutaneous sensibility at least, the representation of locality is 
considerably more complex than this simple plan. 


The representation of locality. Graham Weddell and his Co- 
workers (1955a,b,c) have recently completed a detailed quantita- 
tive study of the anatomical relations of the nerves which innervate 
hairs on the rabbit ear. Since this biological information system 
is not normally active except when the ear has been stimulated by 
mechanical deformation, it is an obviously convenient site for the 
study of the way in which locality is represented. The relevant 
features are briefly described: some 5,000 dorsal root nerve fibers 
innervate approximately 100,000 hairs on the dorsal surface of 
the rabbit ear; histological examination of individual hairs 
shows that the single hair receives innervation from some 4-6 
nerve fibers on the average (although certain of the large 
guard hairs may be innervated by as many as 26 separate 
dorsal root nerve fibers). It is deduced from the above facts that 
each dorsal root axon entering the ear sends branches to some 80 
hairs. A single stem axon and its 80 peripheral branches may 
therefore be considered as a ‘“‘bottleneck channel.’’ This arrange- 
ment is undoubtedly analogous to the ‘‘bottleneck’”’ in the visual 
system discussed by H. D. Landahl (1939) and by A. Rapoport 
(1955). In fact, the ratios are similar; some 10° photoreceptors 
map on 10° ganglion cells while 10° hairs map on 5 x 10° dorsal 
root axons. Moreover, since it is also virtually certain that this 
same type of ‘‘bottleneck’’ exists with regard to the thermal and 
pain sensations in man, there is little doubt that the plan is of 
general importance to neurophysiology and that the elucidation of 
its mechanism and purpose is of interest to the subject of informa- 
tion theory. 

In his analysis of the bottleneck problem, Rapoport was con- 
cerned with the coding of a message to be sent through a bottle- 
neck so that a minimum loss of information would be sustained. 
Two approaches were used: (1) the construction of a McCulloch- 
Pitts net to effect compression without serious loss of information, 
and (2) the utilization of optimum connections in a bottleneck to 
minimize the inevitable loss of information. In these approaches it 
was necessary to neglect frequency response (to variations in bright- 
ness in Rapoport’s first example) in order to make use of binary modu- 
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lation coding. In the present paper it will be shown how a particular 
biological information system localizes stimuli which are trans- 
mitted through bottleneck channels, without making use of binary 
modulation coding. It is necessary that this system should be so 
designed because the axon which transmits information about lo- 
cality also transmits information about intensity of stimulation in 
such a way that intensity is represented by frequency of end-organ 
response. It is therefore assumed that the only coding of which 
the hair receptor is capable is frequency modulation. This in turn 
implies that both cause and locality are predetermined. In other 
words, any impulse of whatever number or frequency in this sys- 
tem can have been caused only by mechanical deformation of hairs 
on the rabbit ear, and no coding occurs with regard to cause. It 
will now be shown how locality is predetermined by a network of 
connections. This network is in fact a McCulloch-Pitts net and 
may be treated by the logic of propositions. 

Figure 1 shows diagramatically a single dorsal root axon and 
the hairs which it innervates together with the corresponding cor- 
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FIGURE 1 


tical cells to which it is attached (through internuncials). When 
hair A is stimulated alone, an action potential begins its course 
to the dorsal root axon. During the time interval between its in- 
itiation at hair A and its arrival at the first branching (point 1) 
the action potential could have originated only from hair A. There 
is complete certainty with regard to localization, and the action 
potential can be regarded as having a value of 1 binary unit (with 
regard to activity) but no additional information is needed with 
regard to localization. Between points 1 and 2 an action potential 
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could have originated at A, at B, or at A and B simultaneously. If 
there is no action potential then neither A nor B were acting. If 
‘‘impulse’? be defined as either an actual impulse or a non-im- 
pulse during a given time then an ‘‘impulse’’ could arise from A 
and B, A but not B, B but not A, or neither A nor B. To specify 
each of these four possibilities requires 2 messages or 2 bits of 
information; i.e., two ‘‘impulses’’ would be needed, using ideal 
coding. Between points 1 and 2 therefore, the information of each 
‘‘impulse’’ can be given as 0.5 bits per ‘‘impulse.”’ At point 3 an 
‘‘impulse’’ could have originated with equal probability from any 
of the 2°° possible combinations of the 80 hairs. To specify the 
the combination requires 80 bits of information so that one may 
speak of the information of each impulse as being 0.0125 bits. 
There are two factors to be considered with regard to loss of in- 
formation per impulse in passing from hair cell to a stem nerve 
fiber. First it requires relatively little information to estimate the 
actual number of hair cells which are being stimulated within a 
small region since hair cells which are far apart would have little 
if any interaction. For biological purposes approximate estimates 
of (1) the total number of hair cells stimulated, (2) the ‘‘center of 
gravity’’ of the ‘‘stimulus,’’ and (3) a rough specification of the 
‘*shape’’ of the ‘‘stimulus’’ pattern are required. It is only when 
the external stimulus is small that fine representation introduces 
difficulty. Hence one need only consider situations in which a 
relatively small number of hair cells are stimulated. This enor- 
mously reduces the amount of required information. A second 
factor is that the hair cells would be expected to fire independ- 
ently when considered at the synaptic delay time level. Even 
with high impulse frequencies the proportion of impulses which 
arise from the firing of more than one hair cell will be small un- 
less the density of hair cells stimulated is large enough so that 
an appreciable fraction of the stem nerve fibers is being stimu- 
lated by more than about perhaps 5 hair cells. Because of these 
two factors, we may generally consider the situation in which 
there is only a single hair cell or at most a very small number of 
hair cells being stimulated at a given moment of time. It is em- 
phasized that the action potential does not lose value with regard 
to cause or frequency throughout its course to the dorsal root axon 


and to the cortex; it is only in regard to locality that information 
is lost. 
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It will be found useful to give some numerical examples; to do 
this it is necessary to calculate the loss of information undergone 
by an action potential as it passes from its site of origin to the 
parent axon and then to the cortex. The numerical assignment is 
in a sense arbitrary since more than one method is possible. In 
this paper, the value in bits of an action potential with respect to 
locality is 1/n at any given point p, where n is the number of hair 
cells from which, at that point p, the action potential could have 
originated. It will be shown below that the locality of a given hair 
is ultimately determined by the pattern of cortical cells activated, 
the ‘‘center of gravity’’ of any particular pattern being unique for 
a particular single hair stimulation. An alternate method pointed 
out by H. D. Landahl is to equate the number of bits required to 
localize the hair (6.32 in the case of the above example) with the 
actual pattern which localizes the hair, dividing the information 
equally among the component parts of the pattern. In the model 
system constructed below (Figure 2) it happens that one out of 
each 5 of the axons activated by the stimulation of a single hair 
evokes a pattern (Figure 2a) the center of gravity of which is the 
same as that of the total pattern. On equating this pattern (2.32/5 = 
0.46 bits per impulse) to the information conveyed by a single 
action potential in the central axon, the remainder of the action 
potentials may be considered as excess information. There are 
advantages to both methods; however, in the natural system where 
there is a much greater economy of transmission lines the majority 
of cortical patterns of localization are not equivalent with any 
single pattern produced by one axon. For this reason the first 
method of calculation will be used in this paper (see Appendix 1). 

It is felt intuitively and it has been shown by experiment that 
the axon, through internuncials, ultimately branches centrally into 
at least as many branches as it gives rise to in the periphery. It 
is reasonable to assume that the axon ultimately innervates 80 
cortical cells corresponding to the 80 peripheral hairs. Thus when 
the action potential arrives at the cortex it activates a// the central 
cells innervated by that particular dorsal root axon. The informa- 
tion value of each of these activations cannot exceed 0.0125 bits 
with regard to localization. In other words, an activation in cell a 
might have originated in any one of the hairs A, B, C, D, E,...; 
similarly for the case of cells b, c, d, e,.... However, there are 
80 cortical activations in 80 different cells when one axon is stim- 
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ulated and the algebraic sum of their values with regard to locality 
is 1 bit. It thus seems incorrect to regard the information about 
locality in the original action potential as having been lost; on the 
contrary, information has been distributed by this central pattern 
uniformly among 80 activations. 

It was previously mentioned that each hair is innervated by an 
average of 5 separate terminals from as many separate axons. This 
means that an average of 5 separate axons are activated by stimu- 
lation of a single hair and that a theoretical maximum of 400 sepa- 
rate activations could occur in the cerebral cortex. Taken together, 
the 400 activations (each of value 0.0125 bits in regard to locali- 
zation) constitute a maximum of 5 binary units of information. It 
therefore is logical to expect that the 400 action potentials with 
this information should be utilized so as to localize the hair. 

To show how this may be done it is necessary to consider a sim- 
plified model pattern of the activated cortical cells. It is empha- 
sized that in this model system there is no saving of axon fibers. 
Figure 2 shows several diagrammatic representations of cortical 
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cells for various stimulus patterns. Each circle represents a par- 
ticular hair on the rabbit ear and stands in the same relation to 
adjacent cells as the hair which it represents does to adjacent 
hairs. In this model, each dorsal root axon innervates 5 hairs in a 
pattern as in Figure 2a; and each hair is assumed to innervate 5 
dorsal root axons. Moreover, these four other axons are the four 
nearest axons. In addition, it will be assumed throughout the re- 
mainder of this paper that temporal considerations play no part in 
the determination of locality (see Appendix 2). This is a reasona- 
ble assumption since it has already been indicated that the average 
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frequency represents stimulus intensity. Moreover, most stimula- 
tions of hairs give rise to a burst of action potentials whose fre- 
quency must be near the limit of the ability of the axon to conduct, 
Finally, it is assumed that single stimulation of a single ending is 
adequate to fire all the stem nerve fibers which innervate the hair 
and that the thresholds of the internuncials are low enough to be 
fired by single impulses. 

Continuous stimulation of a single axon would give rise to a 
pattern such as in Figure 2a. However, the actua! pattern gen- 
erated by the continuous stimulation of a single hair is shown in 
Figure 2b. Now a single hair which is innervated by 5 axons, 
each of which also innervates 5 hairs, could when stimulated gen- 
erate a theoretical maximum of 25 cortical activations; but because 
of the overlap which is necessary for localization, only 13 cells 
in the cortex are in a state of continuous activation during con- 
tinuous maximum stimulation of a single hair. If the convention is 
adopted that the single activated cell, which is completely sur- 
rounded (e.g., in 8 directions) by activated cells, is the represent- 
ative of the single stimulated hair, then in this model one and only 
one cell in pattern 2b is localized. If one considers only single 
hair cell stimulations, each activation in Figure 2a represents 0.2 
bits of information with regard to locality, since a single activa- 
tion could have come from any one of the 5 possible hairs. The 
pattern in Figure 2b can be regarded as consisting of 13 x 0.2 = 
2.6 bits of information. But it only requires log, (1/0.2) =2.32 
bits to localize one of 5 hairs. The hair can be localized; in fact, 
more information is available than is necessary in this example. 
This is obvious from Figure 2b where the center of gravity of the 
points corresponds to the stimulated hair cell. 

If a network such as this existed in the animal, error would be 
controlled (see below) but the system would not be very efficient, 
since 100,000 dorsal root axons would be required to innervate the 
100,000 hairs. A considerable gain in efficiency is made if each 
dorsal root axon innervates some 80 hairs. However, if the pat- 
tern were similar to that in Figure 2b (i.e., if the axon innervated a 
hair and its 79 nearest neighbors), only about 200 cortical cells 
instead of nearly 400 would be set into continuous activity by 
maximum stimulation of a single hair. For these reasons, it is 
therefore more efficient for a single axon to innervate cells over a 
rather large area so that central overlap is restricted to a rela- 
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tively small number of cells toward the center of the area. G. 
Weddell (1955c) has, in fact, traced the collaterals of one degen- 
erating fiber to an area of about 1 cm? in which there were approxi- 
mately 2,000 hairs. Hence the 80 hairs innervated by the average 
single axon are not distributed in the smallest area enclosing that 
number; on the contrary, they are distributed over a considerably 
larger area. In Figure 2b, 25 impulses arrive at 13 available sites 
resulting in 13 activations. The decrease in information is not 
lost; it may be considered to be available in case of chance axonal 
failure. Thus, if a single axon fails, either Figure 2b or Figure 2c 
still occurs with the result that a maximum of a few percent of the 
final pattern is lost. In model, as well as in actual systems, axonal 
or transmission line failures can be controlled to an arbitrary ex-~ 
tent by the degree of overlapping, ‘but actually occurring informa- 
tion is decreased as potential information available (in case of 
axonal failure) is increased. 

Locality in the natural system is determined by the density of 
activated cells: there is a decreasing density of activated cells 
toward the periphery of an area whose center is the cell represent- 
ing the externally stimulated hair. The same considerations also 
apply to the representation of locality of receptors which normally 
respond to external stimulation by long-continued trains of activity, 
such as slowly-adapting pressure receptors, thermal receptors, etc. 
The plan of the bottleneck is such that coding for localization can- 
not take place because of the necessity for transmitting the im- 
pulses representing intensity of stimulation by frequency modula- 
tion. Thus, instead of attempting to pump 6 bits of information 
through a single channel, the system pumps 1 bit per impulse (when 
ultimately amplified) through 6 different channels. Localization is 
accomplished by distributing the central terminals in a pattern 
which is unique for each different single hair stimulated. 

Two possibilities come to mind on inquiring into the advantage 
of such an arrangement. The system ‘‘conserves’’ nervous tissue, 
and reduction in total volume of transmission lines may well have 
been a significant determinant in its evolution. For natural stimu- 
lation, ‘the system is very efficient; there is very little redundant 
tissue in the tract considered as a whole. For example, when 
stimulated a single guard hair occupies some 26 dorsal root axons 
with activations. On the rest of the ear it is unlikely that fewer 
than 10-30 hairs are ever stimulated under natural conditions, and 
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these must make use of some 50-150 axons. The limitation im- 
posed by this gain in efficiency is that only a few per cent of the 
immense number of possible instantaneous spatial permutations 
which are theoretically possible could actually be represented. 
Thus, it is possible to activate all dorsal root axons and all cen- 
tral cells by a pattern not including more than about 500 hairs 
dispersed approximately uniformly over the ear. With maximum 
intensity stimulation of these 500 hairs, all lines would be com- 
pletely occupied so that stimulation of an additional hair would 
not change the received pattern. In other words, the output pat- 
tern would not correspond to the input pattern; the system is un- 
able to represent all the possible simultaneous patterns. So far 
as the animal is concerned, however, this fact is not necessarily 
a disadvantage in that, under conditions of maximum intensity 
stimulation of the ear, it probably not only needs no more informa- 
tion but would be unable to use it. 


The control of error. In the case of minimal stimuli, this system 
can be shown to have the effect of controlling error by limiting the 
effect of single or multiple chance axonal failures. Consider Fig- 
ure 2b. If during the course of activity the central connecting fiber 
fails to transmit, the pattern is unchanged. If any one of the pe- 
ripheral fibers fails, the pattern received is like 2c in which twelve 
cells are in a state of continuous activation. The represented cell 
is still the center of the activated area and the hair is still abso- 
lutely localized. If any two nonadjacent peripheral fibers fail at 
the same time, then the pattern is like 2d; if any two adjacent pe- 
ripheral fibers fail at the same time then the pattern is like 2e; or 
if the central and any peripheral fiber fail together, the pattern is 
like 2f. In all of these last three examples the total amount of in- 
formation is less than 2.32 bits, but the single cell representing 
the stimulated hair is still surrounded by more activated cells 
than any other cell in the pattern. In all cases the center of grav- 
ity is much closer to the point corresponding to the hair cell stim- 
ulated than to any other. 

In the case of the actual system, there is no way in which a 
single chance failure of an axon (or simultaneous failure of two 
axons) can prevent the cell representing the stimulated hair from 
being within the area of maximum density of activation. On the 
other hand, suppression of chance firing during nonactivation would 
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not be expected to occur. This factor is probably of little impor- 
tance for localization in the hair tract system since the minimal 
natural stimulation (10-30 hairs) can hardly fail to evoke some 
4,000 or more central activations and single chance firing beyond 
the transducer stage would not evoke more than about 80 activa- 
tions. Chance failure of a single axon during minimal natural 
stimulation would not be expected to diminish the total number of 
centrally activated cells by more than a few percent, and the rela- 
tive change in pattern would probably be negligible. 

In the model system chance firing can be controlled by the sim- 
ple device of conjunction. If each of the cortical cells of Figure 
2 has a threshold value of 2, then it can be seen that a single 
firing of an axon will not produce a response. A false response 
would require two or more nearly simultaneous false firings of 
axons separated by not more than one axon. When a hair cell fires, 
the requirement of simultaneity is automatically fulfilled. Let Py 
be the probability of a false firing of an axon and 6 be the time 
(~ 107° sec) within which two impulses must occur for response to 
occur. There are oe) = 10 combinations of the five axons which 
must fire falsely in pairs to fire a given central neuron of thresh- 
old 2. Then there will be C(3) (Pp)? false firings in a given inter- 
val 6. If, for example, the axons fire spontaneously once every 
second so that p, = 107%, then the central neuron would fire falsely 
once every 100 seconds whereas a normal active level might be 
perhaps 10 to 100 times per second. Whereas the false firings may 
be reduced by a factor of a thousand, the effect of failures is neg- 
ligible. If three out of five fail, there will still be a response. Two 
out of ten combinations have the center of gravity of the output at 
the representative point, four out of ten have a displacement of 
1/2 the minimum inter-neuron distance, and four out of ten have a 
displacement of 0.707. 

Neurons at the cortical level having different thresholds cor- 
respond to different levels of probability of false firing or false 
non-firing. For example, for a neuron of threshold 5, no failures 
can be tolerated but the probability of false firing is Os) (p)° 
within a time 6. For a spontaneous frequency of 1 per second or 
107® per time 8, the output frequency of false firings would be 
107". For all 100,000 sites, this would give only one firing per 
10" seconds. The neuron of threshold 4 can tolerate the failure of 
any one out of the five axons, but it still gives a false firing fre- 
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quency of only 5 x 10™° or a one false firing per 2000 seconds for 
all the cortical neurons. In this case, as in the case of the neu- 
rons of threshold 5, only the representative neuron fires. 

In this discussion of the representation of locality it ought not 
to be forgotten that cause and intensity of stimulation do not suffer 
loss in value during transmission through the bottleneck; on the 
contrary, each impulse is amplified centrally by multiplication. 
Thus, all dorsal root axons in a sequence would have to fail to 
eliminate cause and intensity of stimulation; hence, error is ef- 
fectively controlled in respect to cause and stimulus intensity. It 
is interesting to compare this arrangement with the theoretical 
system devised by J. von Neumann for the control of error in au- 
tomata (1956). 

Von Neumann’s multiplexing method for the synthesis of reliable 
organisms from unreliable components is relatively simple in prin- 
ciple. Essentially the method depends upon carrying all messages 
simultaneously on a bundle of many lines. The incoming data are 
fed simultaneously into a large number of identical machines and 
the result that comes out of the majority of the machines is as- 
sumed to be true; this much is intuitive. Von Neumann’s ingenious 
idea was to eliminate error in the output by his method of multi- 
plexing. This method can be illustrated in the following way: let 
an input be split into three derivative lines, each of which makes 
contact with an organ which is activated by two (or three) simul- 
taneous activations but not by one. This device, the majority 
organ in von Neumann’s terminology, suppresses a single incoming 
impulse as well as a single incoming non-impulse. Thus the out- 
put is unaffected by a single chance failure of a derivative line 
during activation or a single chance activation during the absence 
of activity. It is possible to decrease the probability of an error 
in the output to an arbitrarily small extent by increasing the num- 
ber of inputs and distributing the derivative lines randomly in the 
bundles which make contact with the majority organs. Assuming 
an initial probable error in a single line of 0.005, von Neumann 
calculated that 20,000 lines in a bundle would reduce the prob- 
ability of malfunction to the order of 10-18, Any technique re- 
quiring 104 lines per input is obviously impractical for present 
technologies of componentry but as von Neumann pointed out is not 
necessarily unreasonable for the micro-componentry of the mam- 
malian nervous system. Both the theoretical model of von Neumann 
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and the biological system described have in common a duplication 
of information to avoid error. Fundamentally, -however, the two 
methods are profoundly different: in von Neumann’s model, single 
events are transmitted by multiplication of transmission lines, so 
that redundancy is increased but efficiency is reduced. In the bi- 
ological system, ‘single events are transmitted over lines common 
to many other possible single events so that redundancy is in- 
creased but efficiency is also increased. Absolute localization of 
10° hairs with complete error control (probability of malfunction of 
the order of 107'°) using von Neumann’s method would require 
something of the order of 10° dorsal root axons; whereas in the 
rabbit ear localization and approximate error control for minimal 
stimulation may be achieved with 5 x 10° axons. 


The author wishes to express his indebtedness to Professor 
H. D. Landahl for many helpful discussions and for the calcula- 
tions in Appendix 1. This work was aided by financial support 
from the Department of Experimental Surgery, McGill University, 
Montreal. 


APPENDIX 


1. It may be useful to present a numerical example of the re- 
sults of a somewhat different method of calculation. As mentioned 
above, fibers have been traced to the boundaries of an area which 
contained some 2000 cells. Suppose that this represents a low 
probability and that an effective distance is about one-half of this 
so that areas containing about 500 hairs are becoming rapidly in- 
dependent of each other and hence one may consider them as a unit for 
some rough calculations. Corresponding to these 500 hair cells 
are 25 ganglion fibers. At the cortex let there be 500 sites cor- 
responding to the 500 hair cells. Each receives collaterals from 
5 neighboring axons. Let each site have 5 neurons of thresholds 
1, 2,...,5. Now there are 25 bits of information per unit time at 
the ganglion fiber lever corresponding to 27° =3.x 107 possible 
combinations of activity. Since 100 impulses is about a maximum 
frequency, the unit of time is here 10 milliseconds. At the corti- 
cal level there are C(**) possible combinations of activity of the 
sites. For each site there are five possible numbers of neurons 
which can act, :e.g., all five, or all having a threshold < 2, etc. 
For each of the C(?>) combinations of five, there are 5° neurons 
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acting. The total number of possible combinations is then 1.7 x 
10°. If these were equably probable, this would correspond to 
as much as 27.4 bits of information. The addition of the possible 
combinations of less than 5 at a time has only a small effect. 
Hence, we see that the cortical neurons can adequately represent 
the information carried by the ganglion fibers which are the limiting 
factor. These can transmit at a rate about that which arises when 
not more than three hair cells are activated within a 10 millisecond 
interval, i.e., a maximum of 300 per second for the unit. This can 
be seen from the fact that the number of combinations of four is 
o(°9°) =2 x 10°, corresponding to 31 bits, while the number of 
combinations of three is 2 x 10", corresponding to only 24 bits. 

2. It is theoretically possible for all the activations, (i.e., about 
400) generated by the single stimulation of an average hair to oc- 
cur, as the following considerations will show. In general, the 
dorsal root axon innervates a more or less circular area and the 
longer its branches the more attenuated they become with an ac- 
companying slower speed of transmission of impulses. Shorter, 
thicker central branches innervate hairs near the center of the area 
and longer, thinner branches innervate hairs near the periphery. 
Hence, cortical cells closest to the center of the activated area 
will be activated first and cells further out are activated later. 
The fact that one cell in a pattern is stimulated first is demon- 
strable experimentally and has led W. R. Adey e¢ al (1954) to sug- 
gest that localization occurs ‘‘in terms of the disposition of the 
point of shortest latency within an activated area of essentially 
constant site and dimensions.’’ This suggestion is incomplete 
because the system must also signal force of stimulation. Sup- 
pose a single hair is stimulated maximally so that the five axons 
innervating it fire at maximum rate; all cortical cells innervated 
by these axons are in a state of continuous activation. After the 
sequence has begun (or, obviously, in the case of long continued 
trains of activity such as thermal receptors generate) the cortex is 
no longer able to identify the cell first stimulated unless the cells 
have reference to time past, which is unlikely. 
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The thermodynamic definition of active transport is restated in terms 
of the rate of entropy production. A substance is said to be transported 
actively when the product of its flux by the force acting upon it across 
the membrane is negative. A general expression for the rate of entropy 
production in a complex membrane in which chemical reactions may occur 
is given, and this expression is developed for a somewhat simplified 
case. The resulting relation is used as a basis for defining and estab- 
lishing experimental criteria for types of active transport. Two basic 
types are distinguished and are designated coupled transport and forced 
transport, respectively. Only the latter type is dependent upon energy~ 
yielding chemical reactions. 


The concept of active transport, implying that certain substances 
may cross biological membranes as a result of the action of forces 
other than those arising from differences in chemical potential (dif- 
fusion), hydrostatic pressure (filtration, transudation), and electri- 
cal potential (transference) across the membrane, has gained wide 
acceptance among physiologists in recent years. There have been 
numerous discussions of possible mechanisms for such transport, 
and attempts at more or less rigorous definitions, but at present 
neither a completely satisfactory definition nor a generally ac- 
cepted mechanism backed by clear experimental evidence has ap- 
peared, and the unequivocal experimental proof that any particular 
substance is actively transported remains difficult. The present 
paper restates and develops the most satisfactory available defini- 
tion and derives from it practical experimental criteria for the 
demonstration of active transport as a basis for further theoretical 
and experimental work on this problem. The argument has been 
based, as far as possible, on physiologically reasonable assump- 
tions and does not invoke radically new types of mechanisms, since 
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it is our opinion that a mechanism of active transport utilizing 
familiar physiological concepts and mechanisms will prove adequate. 
The definition which serves as the basis of the present argument 
is that of T. Rosenberg (1948). He proposed that we consider the 
movement of any substance as active when that movement takes 
place in the direction of increasing electrochemical potential. The 
electrochemical potentials of species j in phases 0 and n are 


Pp = pw; +2,6°5 (1) 
fps pe t+2,", (2) 


in which By and y; are the chemical potentials of j in 0 and a, a, 
is the molar charge of species j, and ¢° and ¢” are the electrical 
potentials in 0 and n. Species j is said to be actively transported 
if there is net movement from 0 to n when 7” is less than 7/7. This 
could occur, for example, with ¢° < ¢” when 2, > 0, or pj < pf, or 
with both inequalities holding simultaneously. The chemical po- 
tential of a substance is related to its molar concentration C; by 


My = Hj +RT In CADE (3) 


where M5 is the standard chemical potential of the substance (u; = 
py; when f,C; = 1), f, the activity coefficient, R the molar gas con- 
stant, and 7 the absolute temperature. 

The practical difficulties involved in the application to experi- 
mental observations are numerous and have been pointed out by 
H. H. Ussing (1948), T. Rosenberg (1954), C. S. Patlak (1956), and 
O. Jardetzky (1957) among others. Two kinds of measurements 
may be used as a basis for experimental studies of transport: net 
flux and unidirectional flux. The net flux measurement is the 
classical one in studies of diffusion and permeability and has the 
advantage that results of such measurements can be used in thermo- 
dynamic calculations. However, in numerous cases, notably those 
of the nerve and muscle cell membranes, technical problems make 
it difficult to obtain net flux values of appreciable magnitude; and 
unidirectional flux values, measured by isotopic techniques, have 
provided the most convincing evidence of active transport. Using 
T. Rosenberg’s criteria as originally stated with net flux data will, 
as several writers have pointed out, lead to erroneous conclusions 
in many instances, especially under conditions where the ‘‘pas- 
sive’? movement of the substance in question is large relative to 
the ‘‘active’’ movement. On the other hand, unidirectional flux 
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data are not directly applicable to thermodynamic formulations such 
as that of T. Rosenberg (1948), and the criteria for active transport 
proposed for use with such data (Ussing, 1948; Jardetzky, loc.cit.} 
are not wholly reliable. C. S. Patlak (loc. cit.) has examined cri- 
teria for active transport based on unidirectional flux data and has 
also derived relations between net flux and concentration for a 
simple case of active transport and finds the latter to be complex 
formulations of no great practical value. They can be simplified by 
making a large number of assumptions, some at least of which will 
be invalid in most actual situations. - 

A useful modification of the T. Rosenberg’s (1948) definition was 
suggested to me by P. Van Rysselberghe and forms the basis of 
the present discussion.’ Consider a system of two homogeneous 
phases, 0 and n, separated by a membrane M.° The properties of 
the membrane are not specified, except that there must be no net 
uptake or formation of any constituent of 0 or n by the membrane 
during the observations. The forces acting across the membrane 
may be represented by the electrical potential difference ', where 


E=$°-¢"; (4) 
by the hydrostatic pressure difference P, where 
P= P® —P*, (5) 


and by the difference in chemical potential Ap; of the components 
j of 0 and n, where 


Va es ES (6) 


The net flux J; of any component across unit area of M, positive in 
the direction from 0 to n, is defined as 


eee ee (7) 


where dn, is the net number of moles of species j transferred across 
unit area of M from 0 to n during time dt. The theory of the thermo- 
dynamics of irreversible processes (DeGroot, 1951; Progogine, 1955) 
gives us, for the rate of entropy production d *§/dt due to the simul- 
taneous net fluxes J; (j = 1,2,...,¢) from 0 ton: 
- d*s fr iee 
ee eae ©) 
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The asterisk in d*S serves to recall that d*8 is the entropy produc- 
tion during time d¢ and not the total entropy change dS; Xx, repre- 
sents the total force acting upon j across the membrane and is 
given by 


X,=2,E +0,P + Ap, (9) 


where v, is the partial molar volume of j, assumed to be the same 
in 0 andn. X, is assumed to act only along one coordinate axis at 
right angles to the membrane in a system of rectangular coordinates; 
the system is assumed to be homogeneous along the other coordinate 
axes. 

The second law of thermodynamics requires that, both for the 
whole system and any small homogeneous portion of it, the rate of 
entropy production be not negative: 


d*§ 
Z0 
dt 


(10) 


If, for the whole system, the only irreversible phenomena are 
the fluxes J,, this rate of entropy production will be given by (8). 
If the processes occurring within the system are all reversible, 
d*S/dt will be zero; otherwise, and in all actual systems, it will 
be positive. Processes of diffusion, transference, and transuda- 
tion are invariably irreversible and are accompanied by positive 
rates of entropy production. An active transport process, in which 
a substance is moved against electrical, chemical, or mechanical 
forces, will contribute a negative term to the total rate of entropy 
production, which must be compensated by larger positive contribu- 
tions due to other fluxes or other irreversible phenomena. 

We shall say that, tif for any substance i there is a value of X, 
and a corresponding value of J, such that the term J,X, of the sum- 
mation of 8 is negative, then the substance is actively transported. 
It should be made quite clear at this point that, since this is a 
thermodynamic definition, it applies only to net fluxes. There will 
be, therefore, some circumstances in which an active process is 
in operation, but in which it will not be evident in a negative value 
of the JX product. Two such situations, the leaky membrane and 
facilitated transport, are discussed at the end of this paper. How- 
ever, as the definition is stated, it should be possible to find ex- 
perimentally values of X,, and hence of J,, such that the existence 
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of an active process can be demonstrated in accordance with the 
above definition. 

This definition offers opportunities for further exploration of the 
nature of the transport process and for the development of defini- 
tions of several sorts of transport and the establishment of experi- 
mental criteria for the demonstration of each sort. It appears prob- 
able, from presently available knowledge, that most biologically 
active membranes, whether they be simple cell membranes or multi- 
cellular membranes, have a multilayer structure and that active 
transport is directly energized by chemical reactions occurring in 
some of the layers. 

We shall consider a system of n phases, 


ye Sie ieee Sere eee P P.,,P 


a-1? G41 Ae Sa? 1a rit eG eee. 


PoP 


n-i?” n? 


arranged in series along the axis of a system of rectangular co- 
ordinates at right angles to the surface of the system. The first 
and last phases, P, and P_, called the outer and inner phases re- 
spectively, will be reservoirs of infinite volume, while the other 
phases, P, through P__,, may be of finite volume. Each phase is 
separated from the next by a membrane of thickness negligible by 
comparison with the thickness of the adjacent phases. The mem- 
branes will be designated by the same number as the phase which 
lies to the inside of the membrane, thus 


MMe .M 


a—19 “ae? att? - 


M,, M 


at 19a?) “are tae 9 


M M 


fe cad eons 


The components of P, and P, will be of two sorts, not necessarily 
distinguishable by direct observational criteria. One type of com- 
ponent, designated by a, b, c,...,7, does not enter into chemical 
reactions within the system; the other type of component, desig- 
nated by a, B, y,---,t, does enter into chemical reactions. Both 
types of components may diffuse within the system. 

The chemical reactions may occur in any phase other than the 
phases P, and P_, or in the membranes; and any component might 
enter into more than one reaction. However, for simplicity, we 
shall later assume that any one component forms only a single 
derivative in any one reaction and enters into only one pair of re- 
actions. We shall designate the reactions involving component o 


by py > Pore? and the reactions will be written 
1 


Po,’ SE Ea nanan Og ee 
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where Yoo, and Vg, are stoichiometric coefficients, and 4,,,,..., 
are derivatives of &. It should be noted, however, that no assump- 
tions are made here concerning the nature of these derivatives, 
save that they are related to a by a stoichiometric reaction. An 
essential restriction on the reactions involving any component such 
as & is that in some part of the system spatially separated along 
the axis from the site of the first reaction another reaction, Po, ‘ 
must take place in which « is regenerated from its derivative, thus: 
Py? Dy ye weg ie ae ++ 

We shall refer to the second reaction, pj, , as the reciprocal reac- 
tion, and in general the reciprocal reaction cannot merely be the 
reversal of the initial reaction, unless one of the two is energeti- 
cally coupled to some other reaction in such a way that there is a 
net decrease in free energy for the entire process. For thermody- 
namic purposes, it would be best to consider that the unspecified 
reactants and products of the pair of reactions formulated above 
include the components of the coupled reactions if any, so that the 
final pair of equations will specify the thermodynamically complete 
process rather than a partial reaction only. For our present dis- 
cussion, the incomplete reactions will be sufficient. 

The general equation for rate of entropy production of this system 
may now be written as 


d*8 M=M, P=P,-; 
aS y Tu Xiu + De “S Jp Xy p + 
k M=M, k P=P, 


D4? 0, (11) 
p 


where & includes all components of P, and P_, such asa, b,c, ...,% 
and 4,B,y,..., and all reaction products such as « 1» Xgyeeey 
B,, B2,-.., and the reactions p include all reactions whether in 
the phases or the membranes. The fluxes J, m are those across the 
respective membranes, while the fluxes J,,p occur across the re- 
spective phases between the membranes. The forces X are similarly 
defined. A, is the electrochemical affinity and V, is the velocity 
of the reaction p. The affinity is related to the chemical potentials 
by 


Ap= — 2, pts (12) 
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where ey is the stoichiometric coefficient of component : of re- 
action p, and #, 1s the chemical potential of « in the phase in which 
reaction p occurs. 

We may simplify equation (11) by the assumption commonly made 
in diffusion and permeability studies, and in general reasonable, 
that the quantity x, p» Which is strictly speaking the integral 
JX, dz between the two SA te of the phase P, is negligible 
by comparison with the xX, y 8 for the membranes on either side of 
P, Since the J, k,m Values will be of the same order of magnitude 
as, and usually equal to, the corresponding J, _p Values, equation 
(11) then becomes 


cree g ag uXiut+ D. 4,V,3 0. (18) 
P 


We shall also find it useful to subdivide the rate of entropy produc- 
tion of the system into terms representing the individual compo- 
nents of the system and, assuming that each reacting component 
such as & forms only a single derivative «, , write for example: 


d*§ 
r Visas Ds Jou Xam? (14) 
M 


and 


a*S 
: ate aa ee a oxi ow * Dadra Vo, (15) 


It should be pointed out that individual JX or AV terms such as 
those making up the summations of (14) and (15) need not be posi- 
tive. If any J,X, term is negative, then from our definition the 
corresponding component i is undergoing active transport. How- 
ever, as a practical matter we cannot evaluate equations (14) or 
(15) without detailed knowledge of the events occurring in the sys- 
tem, in other words, of the mechanism of the transport. The equa- 
tions become simpler in certain states into which the system may 
be brought experimentally, and for such states they may be useful. 
C. S. Patlak (Joc. cit.) has distinguished equilibrium, pseudo- 
equilibrium, steady, and transient states. The equilibrium state 
will not concern us here, since no active transport can occur in a 
system in thermodynamic equilibrium and the analysis of transient 
states would lead us back simply to equations (14) and (15). The 
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steady state and the pseudo-equilibrium or dynamic equilibrium 
state offer possibilities for the further development of the entropy 
production equation (13). 

In the steady state, the chemical potentials of the components of 
the system at any point do not change with time. This state is 
probably attained within a relatively short period of time by most 
transport systems if left undisturbed between two large reservoirs 
of suitable composition. Rigorous demonstration that a steady state 
exists is not in general possible with a complex system. We may, 
however, suppose that when the fluxes of all components between 
the external reservoirs and when the electrical potential difference 
across the system are constant with time, a steady state has de- 
veloped. In the steady state, we will have for example 


Me PEE SE Be (16) 


By definition, in the absence of hydrostatic pressure differences, 


we have 
Xioos = Ate 10 + Ag hye Mey Hae + Pulb goa) (17) 


and similarly for each successive membrane. Hence, 


De Xo.m = Hoyt ~ Han + 20 ($1 — bn) = Xe- (18) 
M 
Consequently, equation (14) becomes 
rh ssi =J X_, (19) 
a dt ete 


where J, is the flux of a from P, to P,, and X, is the force acting 
on a between 0 and n as defined in (18). 

For those components which enter into reactions in the system, 
the relations are more complex. The exact form will depend upon 
the arrangement of reactions within the system. We shall consider 
the simple case in which each pomponent such as d enters into a 
single pair of reactions Po, and Pex, in phases a and a’, or in mem- 
branes a +1 and a’, forming i in phase a or membrane a + 1 a single 
derivative o, es is reconverted to « in a’, Then in the steady 
state we will have 


Vv 
a = 
Jeu = Jy = eee = Uy + opi 2 Ju atl eee 
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. (20) 
(oa 
Joa? : Vy Vey .a? - Je art Psa Jon 4 Tey» 
OO, 
and 
dee ey ~ Tee ts =... Dog cart = Tey 5a = Jes (21) 
and 
Teast Meee MI ge IQ (22) 


The portion of the entropy production attributable to « and its de- 
rivative a, will be 


d*S M=n M=a’—-1 
" STP z Tou Xo,u + 52 Jom *o. mM + 
a, Mej Me=a (23) 
| eegpee POSS eee: 
Pox, Po, cai oe 
We may write, after (17) and (18), 
M=a 
» XM = Xo ta? (24) 
M=1 
M=a’ 
Dy Most Xe,00°9 (25) 
M=ati 
M*=n : 
XooM Be Xo an ’ (26) 
M=a’+1 
and define the quantities 
Xo a3 Xe ta + Xa a0’ < Xe a’n? (27) 
and 
Xo " Xa aa’ (28) 


Finally, from the condition that all %” must be reconverted to 4 and 
the steady state, we have 


= - 7 29 
Vase fr. (29) 
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By elementary manipulation we then obtain 


a*S Vey 
T oF =J,Xq+ Jy Xa, - 1 


J, X0 +V, Ap -—A,- ) (30 
O10 Veeck mses Ge) Poe Pete ) 


From (19) and (30), we can then obtain the general equation 


d*§ , re 
eS Bee ee DL Saad lay he foe re + 
i t ll; 1 


(31) 


ae 
Reve A,r) 2 0. 
t 


This equation divides the entropy production of the system into 
four quantities: that attributable to diffusion processes involving 
the non-reacting components 7, that attributable to the reacting 
components 1, that attributable to diffusion processes within the 
system but not between the external reservoirs, and that attribut- 
able to chemical reactions involving the components x. The first 
two sums can be measured and calculated without reference to the 
detailed mechanism of operation of the system; the second two 
sums cannot. It appears reasonable that, in more complex systems 
than the one we have considered, with several reactions for each 
component or several sites of reaction the form of (31) will not 
change, though the complexity of the last two sums may be greater. 

We may now use equation (31) to distinguish two types of trans- 
port and to develop experimental criteria for these types of trans- 
port. Consider the following cases: 


A. Coupled transport. In coupled transport, there is a negative 
contribution to the total entropy production from the transport of 
one or more components of the system. This negative contribution 
is entirely compensated by positive contributions from the trans- 
port of other components present in the external phases P, and P|; 
chemical reactions within the system are not necessary to account 
for the transport from the standpoint of mechanism nor to compen- 
sate for the negative contribution to the entropy production. The 
criterion for coupled transport is 


JX, <9, (32) 


D728. (33) 
i 


when 
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where @ is the component undergoing coupled transport and the 7s 
include all components of the external phases. These criteria may 
be applied directly if it is feasible to compute flux-force products 
for all components of P, and P_ in one or more steady-state condi- 
tions. We may also expect the linear phenomenological relations 
of Onsager to hold sufficiently close to equilibrium (Prigogine, 
loc. ctt.), and we may accordingly write 


Jae) glas x, (34) 
i 


If experimentally we make x, for all j’s equal to zero, we will have 
in the steady state 


J,=0 for X,=0. (35) 


This will be a test for coupled transport, with one exception. If 
forced transport (see below) is occurring in the system but is of 
such a nature that the flux J, of the transported component a is a 
function of some X, such that when x, is zero then J, is also zero, 
the criterion of (35) would give a false indication of coupled 
transport. 

Another test for-coupled transport can be made by bringing the 
system to the state of pseudo-equilibrium, where the flux of all 
components between P, and P_ is zero. Under these conditions our 
basic equation will still apply, and if only coupled transport is 
occurring, 


X,=0 for J =0. (36) 


This criterion is more rigorous than (35), though somewhat more 
difficult to apply in practice. Coupled transport probably occurs in 
most situations where several components are diffusing simul- 
taneously. L. J. Gosting and coworkers (Baldwin, Dunlop, and 
Gosting, 1955; Dunlop and Gosting, 1955; Fujita and Gosting, 1956) 
have examined some simple cases both theoretically and experi- 
mentally. Most biologists would probably prefer to exclude coupled 
transport from the category of active transport, since it is not nec- 
essarily dependent upon metabolic energy expenditure. 


B. Forced transport. Here the negative contribution to total 
entropy production from the transport of one or more components of 
the system is not completely compensated by positive contributions 
from transport of other components of the external phases, but in 
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part by positive contributions arising out of chemical reactions or 
out of the transport within the system of the products of chemical 
reactions. The criteria for forced transport are, therefore, for some 
value of X,, 


TER AaO (37) 


Se J,X,<0, (38) 
j 


where & is the component transported by forced transport. The 
linear relations of the form of (34) will not apply to «4. Therefore, 
when x, for all components is made zero, 


Jyx0 for X,=0. (39) 


This is the experimental criterion first used by H. H. Ussing and 
K. Zerahn (1951) to demonstrate active transport of sodium ion 
across isolated frog skin, in their well-known ‘‘short-circuited 
skin’? experiments. The experimental arrangement has also been 
used very effectively to study the action of various agents on the 
transport process itself, since fluctuations in the value of J, when 
the X,’s are zero can be taken as indications of fluctuations in the 
power of the transport mechanism (Ussing, 1954). Use of the test 
of (39) might result in failure to observe forced transport in cases 
where such transport occurs at values of x; other than zero, but 
stops when x; is zero; the use of (37) and (38) would resolve this 
difficulty, or one can do as with coupled transport and bring the 
system to the pseudo-equilibrium state. Then we will find, for the 
transported substance a, that 


X,* 0 for J,=0. (40) 


Another test, very widely used, rests upon the dependence of 
the transport mechanism on an energy-yielding chemical reaction. 
It has often been supposed that, if the flux of some component of 
the system stops or is reversed when some energy-yielding reaction 
is inhibited, then that component is actively transported. This is 
not necessarily the case, since the inhibitor may modify membrane 
permeability or electrical potentials within the system, or alter the 
flux of other components to which the flux in question is coupled. 
If we examine equation (31) and consider that in the steady state 


J = Vo, ’ (41) 
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it can easily be seen that equation (31) may be expressed as 


d*§ 
s dt = 2D IX DY, M0, (42) 
t t t 


where M, is a function of the chemical potentials of « and of its 
derivative «,; of the other components of the pair of reactions in- 
volving these two; of the electrical potential difference between 
the phases in which the reactions occur; and of the stoichiometric 
coefficients of the reactions. We can then state as criteria for 
forced transport of « that, for some value of ae 5 


dae ator V5> > 0 | (43) 


Panes Us tor Vv" 


a 


yon 0% (44) 


When the criteria are applied in this form, there is no confusion in- 
troduced by possible effects of the inhibitor on passive permeability 
of a membrane in the system or on the electrical potential difference 
across the system, since such effects would not change the sign of 
the force-flux product but only its magnitude. The criteria would 
fail in the case that the component is carried by coupled transport, 
and the coupling transports another component which is carried by 
forced transport. The use of (40) would eliminate this source of 
confusion. 


C. Facilitated transport and leaky membranes. It should be 
stated again, if it is not clear from the foregoing argument, that 
there are experimental situations in which an active transport proc- 
ess is in operation, but in which the criteria proposed above will 
fail to demonstrate the existence of the process. One example 
which has been much discussed we may call facilitated transport. 
In this type of situation, an active transport process is in operation, 
but the substance transported moves along a decreasing electro- 
chemical gradient. A second example is that of the leaky mem- 
brane, across which diffusion is so rapid as to mask completely 
the active movement of a substance in a direction opposed to the 
diffusion gradient. The criteria as proposed above might fail in 
either of these situations. However, it should in general be pos- 
sible to manipulate the experimental conditions in such a way that 
the criteria will apply. The most reliable criteria, for any situa- 
tion, are those in which the electrochemical gradient is reduced to 
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zero so that no diffusion occurs [equation (39)], or in which the 
system is brought to pseudo-equilibrium [equation (40)]. There re- 
mains the hypothetical case in which the active process operates 
only under conditions of facilitated transport, but this case is at 
least of no great practical importance. 
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A RELATIONAL THEORY OF BIOLOGICAL SYSTEMS 
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The relational phenomena exhibited by metabolizing systems may be 
considered as special cases of those exhibited by a more general class 
of systems. This class is specified, and some of its properties de- 
veloped. An attempt is then made to apply these properties to a theory 
of metabolism by suitable specialization. A number of biologically sig- 
nificant theorems are obtained which apply directly to the theory of the 
free-living single cell. Among the results obtained are the following: 
On the basis of our model, there must always exist a component of the 
system which cannot be replaced or repaired by the system in the event 
of its inhibition or destruction. Under certain conditions, a metabolizing 
system possesses a component the inhibition of which will completely 
terminate the metabolic activity of the system. Furthermore a number of 
other diverse phenomena, such as the effects of a deficient environment, 
encystment phenomena, and even an indication of why a metabolizing 
system which represents a cell should possess a nucleus, follow in a 
straightforward fashion from our model. 


I. Introduction. An important aspect of the activities of an or- 
ganism for which we would like to account may be summed up in 
the word ‘‘metabolism.’’ Speaking very roughly, the metabolism of 
an organism may be visualized as a sequence of operations whereby 
a set of materials drawn from the environment (which we shall term 
input materials) are transformed into a new set of materials (out 
put materials) which are directly utilized by the organism in some 
fashion. The study of this sequence of operations is one of the 
fundamental problems of biology. 

In the crude definition of metabolism presented above, we al- 
ready notice a similarity between the metabolic process and the 
behavior commonly exhibited by a large variety of man-made me- 
chanical and electrical devices. We shall employ the generic term 


QA5 


246 ROBERT ROSEN 


system to designate any type of structure which acts, through a 
certain sequence of operations, to produce a definite set of output 
materials from a given set of input materials, or from a given set 
of environmental conditions. This definition is compatible with 
the usage introduced in other studies of general systems (see e.g., 
Hall and Fagen, 1956), but our treatment will place greater empha- 
sis upon the relational aspects of systems than is customary in 
the literature. It is then reasonable to suppose that a study of 
these relational properties of general systems may help to throw 
some light upon the problems of metabolism. The present study 
will attempt to explore some of the possibilities of this approach. 

Let us make some general remarks concerning the types of prob- 
lems which arise in the study of systems of the type described 
above. Let us observe that the problem of determining the struc- 
ture of a given system resolves itself naturally in two more or 
less distinct parts. In the first place, we can regard the system 
as a collection of simpler, fundamental subobjects (which we shall 
term components), each of which also behaves in such a manner 
as to produce a definite set of output materials from a given set of 
input materials. These components are to be related to one an- 
other in the obvious manner; the output materials of a given com- 
ponent may serve as input materials to other components of the 
system. There will generally be other relations obtaining between 
the components of a given system; a complete enumeration of these 
relations will then determine the behavior of the system and will 
constitute a solution to what we may term the coarse structure 
problem of the theory of systems. Much of the information required 
for a solution of the coarse structure problem for a given system 
will be contained in the so-called block diagram, or flow chart, 
for the system. 

For the purposes of the block diagram, we see that each com- 
ponent is regarded as a structureless element (i.e., a ‘‘black box’’). 
Once a coarse structure has been obtained (i.e., once we have de- 
composed our original system into a suitable set of components), 
we may begin to inquire about the actual physical realizations of 
these components; this aspect of the theory of systems may be 
termed the fine structure problem. Speaking very roughly then, the 
coarse and fine structure of systems bear to each other the same 
relation as do macroscopic and microscopic states of a thermo- 
dynamic system, as do physiology and anatomy, or, in Rashevsky’s 
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terminology (Rashevsky, 1954), as do relational and metrical as- 
pects of biology. 

To illustrate the preceding statements, let us consider a very 
simple, non-biological example. Let the system in question con- 
sist of an ordinary radio receiver set and let the term ‘‘block dia- 
gram’’ be given its customary meaning in this context. One of the 
components of the block diagram will be labeled ‘‘amplifier’’; this 
is sufficient to fix its coarse structure. When we come to con- 
sider the fine structure of this component, however, we observe 
that it is possible to construct amplifiers in a large number of 
fundamentally different ways; e.g., we may use a standard vacuum 
tube circuit, or a transistor circuit, or a klystron, or a traveling- 
wave tube. Even restricting ourselves to a single technique, for 
example to vacuum tubes, we find it possible to design many dif- 
ferent, yet equivalent, circuits, and in fact to construct the same 
circuit in an unlimited number of physically distinguishable ways. 

In biology itself, we find a wealth of similar situations. Thus, 
for example, we find that beef insulin differs from swine insulin, 
which in turn differs from human insulin; we find that the hemo- 
cyanins differ from hemoglobins, even though from the point of 
view of what we have termed coarse structure these groups are 
equivalent. 

Thus we see that it is in principle possible to find two systems 
which have identical coarse structure but are totally different in 
their fine structure and hence from the point of view of external 
observation do not resemble each other to any extent. These con- 
siderations may be generalized to the following: 

1. Any component of a system may be realized by infinitely many 
pairwise distinguishable physical structures. 

2. It is not necessary that a component in a block diagram be 

recognizable by means of a physical landmark in a particular re- 
alization of the system. 
These principles, which as we have seen are already manifest 
even in the simplest systems, serve to make the inductive recon- 
struction of a block diagram from an unknown system (which is the 
analog to the problems we face in biology) extremely difficult. 
Most of the observational techniques at our disposal will yield 
only fine structures; it is probable that most of the extant bio- 
chemical literature, for example, deals with problems of fine struc- 
ture in this sense. 
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The qualitative facts of biology seem then to be expressible in 
this form: Distinct living organisms are largely similar in their 
coarse structure, while possibly differing widely in their fine 
structure. For this reason, and in view of the great difficulties 
which are involved as indicated above, in passing inductively 
from fine to coarse structure, it appears that an approach from the 
point of view of the coarse structure may be fruitful for the study 
of biological systems. 


Il. General Properties of Arbitrary Systems. Let M be an ar- 
bitrary system and let us suppose that by some means we have ob- 
tained a decomposition of M into components. The first obvious 
notion which we may introduce, suggested by the very appearance 
of the block diagram, is that of the graph of the system. The ver- 
tices of this graph will represent the components of the system, 
and the presence of an oriented edge joining two vertices M,, M; 
will indicate that some output of is an input to M@. An input to 
a component which is not the output of another component of M 
will be termed an environmental input to M; likewise, an output of 
a component which serves as input to no other component of M will 
be termed an environmental output of M. A component of M which 
receives an environmental input will be called an origin of M; a 
component which emits an environmental output is called a terminus 
(or terminal component) of M. 

By a subsystem M’ of M we shall mean a subset of the set of 
components of M, connected as in M, such that: 

1. The set of environmental outputs of M’ contain a subset of 
the environmental outputs of M. 

2. M’ receives no inputs from any component of M which is not 
in M’, 

To illustrate these definitions, let us consider the system the 
diagram of which appears in Figure 1. In this diagram, the letter 
E corresponds to a formal component representing the environment. 
According to our definitions the components M 1» M,,M, are origins 
of this system, M,, M,,M, are terminals; further, iM,, M,,M,.M, 
is a subsystem. On the other hand, {M., M,, M,} is not a sub- 
system, since M, receives an input from M 4) likewise, iM, ,M git is 
not a subsystem, since none of its outputs coincides with an en- 
vironmental output of the entire system. 
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FIGURE 1 


The graph alone does not provide us with all the information we 
desire concerning the operation of the system. For example, it 
is intuitively clear that in some sense certain components will be 
more important than others to the operation of the system. We shall 
take as a measure of the importance of a component to the system 
the number of environmental outputs of the system which cease to 
be produced by the system when the component in question is in- 
hibited or removed. In greater detail, let us denote by @ the total- 
ity of environmental outputs of the system M, and to each com- 
ponent M, of M we assign a set S, Cc @ which will be the set of en- 
vironmental outputs of M that are terminated when M, is inhibited. 
We shall call the set S, the dependent set of the component M,. In 
general the dependency structure of a system must be given sepa- 
rately, but we shall soon see that in certain special cases we may 
obtain the dependent sets of the components of a system directly 
from its graph. 

Further, we must introduce some means of representing the vari- 
ous time lags which occur in the operation of the system. Broadly 
speaking there will occur two distinct types of lags, namely, those 
which arise in the operation of the components themselves and 
those which arise because of the finite time required for the con- 
veyance of internal inputs from component to component. The first 
type of lag is an intrinsic one; i.e., it is a part of the actual def- 
inition of the system and is an indispensable quantity in the de- 
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scription of every component of the system. This type of lag will 
be called an operation lag. The second type of lag is of a more 
superficial type and will be called a transport lag. The transport 
lags are far from intrinsic and are more closely connected with 
fine structure of systems than with coarse structure. They may, 
for instance, often be modified by such means as the altering of 
the proximity of the components. It will be seen during the course 
of our subsequent discussion that these time lags play a central 
role in the discussion of metabolism. 

If a component produces more than one output, then each of its 
outputs will have its own operation lag. Further, in the most gen- 
eral case, the time required for a component to produce an output 
depends on the particular input materials with which the component 
was supplied. For example, a longer time might be required for a 
proteinase to hydrolyze a protein of high molecular weight into 
peptides than is required for proteins of lower molecular weight. 
Likewise, we expect that the transport lags of different materials 
vary as well. The fact that these lags depend in general upon the 
particular input objects with which components are supplied seems 
to be of importance for the representation of the regulatory aspect 
of biological processes; in particular, they are useful for the de- 
scription of the behavior of a system in a changing environment, 
We shall pursue this matter further in our subsequent discussion. 

We remark at this point that, although the discussion of general 
systems which we have presented above is sufficient for the dis- 
cussion of the following section, it is nevertheless very far from 
being a formally satisfactory treatment. An attempt to prove gen- 
eral theorems on the basis of the structures we have introduced 
above leads quickly to a number of more or less serious difficul- 
ties, the removal of which requires the use of a number of un- 
familiar mathematical techniques. Since this subject will be dis- 
cussed thoroughly in a forthcoming paper and since these diffi- 
culties will not arise in the subsequent section, we do not enter 
into a further discussion at this time. 

Ill. The Metabolic Model. In this section we shall attempt to 
employ the notion of general systems, as described above, to de- 
velop the properties of a group of structures which may perhaps be 
considered as prototypes of a metabolizing system. The systems 
to be constructed possess many of the properties of a free-living 
single cell and provide results which are apparently not readily 
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obisinable in any other manner. The observable behavior of bio- 
logical systems indicates that metabolic activity may be regarded 
from two more or less distinct points of view, namely, anabolism 
and catabolism, and repair. We must evidently incorporate these 
two aspects of metabolism into our structure in a natural way. 

Let us now proceed to the construction of our model. Let M be 
an arbitrary system, with components M,, such that the graph of M 
is connected. In order to avoid the difficulties which were men- 
tioned at the end of the last section, we make the not entirely un- 
reasonable assumption that no component of the system produces 
an output of any sort unless all of the input materials to the com- 
ponent, as indicated in the graph of the system, have arrived at 
this component. We shall refer to this property of components as 
non-contractibility. As usual, we shall denote by © the set of en- 
vironmental outputs of M and by S, the dependent set of the com- 
ponent M,. The hypothesis of non-contractibility enables us to 
obtain the dependent set of each component of M directly from the 
block diagram, since it implies that, for each 2, S, will consist pre- 
cisely of the environmental outputs of those terminals which can 
be reached from M, along one or more directed paths in the block 
diagram. 

We further make the very special assumption that each com- 
ponent M, of M has a finite life-time which we shall denote by u,; 
by this we mean that after M; has been in operation for an interval 
of time of length uv, it shall cease to function. 

The assumption of finite life-time placed upon the components 
of M makes it evident that M will cease to function entirely unless 
its components are periodically replaced before their life-times 
have expired. We now proceed to incorporate such a structure into 
our model; namely, to each component M, of M, let us associate a 
new system, which we shall denote by F,, the inputs of which shall 
consist of a certain subset @, of the set @ of the environmental 
outputs of M and such that the only activity of #, consists in pro- 
ducing a replica of the component M;. We shall assume that the 
output of &, has no transport lag (i.e., the replica of M, begins to 
function as soon as it is produced), and we further assume that 
each Ff, is non-contractible. 

We shall finally impose a condition on the manner in which the 
sets ©, of inputs to the systems Rf, are constructed out of the set 
@ of outputs of M. If Misa ‘sematital of M, let us denote by 7, the 
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set of environmental outputs of M produced by M. We have Ty © Sy 
(where S,, is the dependent set of M); that the inclusion may be 
proper is shown by a glance at the component M, of Figure 1. The 
condition which we shall require is the following: for each terminal 
M of M, 


Ty (V9) 4B. 


That is to say, every terminal M of M produces at least one en- 
vironmental output which serves as an input to some system F,. 
This condition is not the only one which we can impose upon our 
system, but it is biologically plausible and is the weakest as- 
sumption that will yield the results which we shall presently 
obtain. 

A structure satisfying the properties we have laid down will be 
called an (M,R)-system. Speaking very roughly, we may regard the 
system M as representing the anabolic and catabolic aspects of 
metabolism and the set of systems #, as corresponding to repair. 
If we were to take these systems seriously, so to speak, then the 
components M, of the system M might represent enzyme systems, 
while the &, may correspond to the nucleic acids. We may remark 
here that enzymes do have finite life-times. 

Let us now make some observations concerning the behavior of 
these (M,R)-systems. Our first object will be to investigate the 
dependency structure of the system (i.e., the behavior of the sys- 
tem when a component of M is inhibited). The situation here is 
somewhat more complex than before and leads to a number of in- 
teresting results. Let us then inhibit a component M, of M. We 
know then by definition of non-contractibility that every output of 
M in S;, must be suppressed. By our hypothesis that the sets @, 
cover the set ®@ of outputs of M, each output in Si, will serve as an 
input to certain of the systems R;. By our asaunpun of the non~ 
contractibility of the FR, it follows that the termination of M; will 
lead to the termination of all of these R;. By our RE. of 
finite life-time, the M, corresponding to “these R, will ultimately 
cease functioning; the Secon: sets S; of these M, will fail to be 
produced, and so on. The possible baaulte of this behavior are 
summed up in 

Theorem 1. If a component My of an (M,R)~system is inhibited, 
the possible consequences are: 
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1. The system fails completely. 

2. There exists an entire subsystem M’ of M such that M’ (to- 
gether with the corresponding systems R,, M,eM’) is not affected 
by this inhibition. 

Proof. Suppose that there exists a component M, in M which is 
not inhibited in the sense of the above discussion by the termina- 
tion of M; | Then there must exist at least one terminal M of M 
which is likewise not affected by this termination, for the non- 
inhibition of M, implies the non-inhibition of each terminal which 
produces an environmental output in 8,. The subsystem composed 
of the totality of terminals of M not affected by the inhibition of 
M, > together with all components from which these terminals can 
be reached along directed paths in the system, and all the asso- 
ciated systems /#; of these components, demonstrates the second 
possibility. It is clearly a subsystem, for if it were not it would 
have to receive some input from a component that is itself in- 
hibited by the inhibition of M; > which leads to an immediate con- 
tradiction. Further, since every terminal of M is either affected or 
unaffected by the inhibition of M; > the subsystem we have just 
described properly contains all other subsystems unaffected by the 
inhibition of M; and is hence uniquely determined. If, as we as- 
sume, the block diagram of M is connected, then this subsystem 
will not be all of M. 

If we cannot find a component M, unaffected by the inhibition of 
M; > then the first situation above applies. This proves the theo- 
rem. 


A component M, of an (M,R)-system whose inhibition results in 
the failure of the entire system will be called a central component 
of the system. If a component is not central, then the (unique) 
maximal subsystem of M which, according to Theorem 1 is unaf- 
fected by the termination of the component, will be called its re- 
lated subsystem; if M, is a component, we denote its related sub- 
system by M‘. Finally, if M, is a component, and M;-is its related 
subsystem, then the set of ‘all environmental aise of M which 
are not produced by M‘, will be called the augmented dependent set 
_of M, and will be erciod by S,. 

We shall now illustrate these structures by means of a particular 
example. Consider then the hypothetical (M,R)-system the dia- 
gram of which appears below (Figure 2). To avoid an unneces- 
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FIGURE 2 


sarily complicated diagram, we have not indicated the inputs to the 
systems F, directly. However, we shall specify these sets 6, ex- 
plicitly; as follows: 


The reader will readily verify that the component M, is central for 
the system, for the dependent set S, of M, already consists of the 
environmental outputs p,,?.,P3,P4,P;+ However, p, ¢®@,, so that 
the inhibition of M, will be followed by the inhibition of RP, and 
ultimately of M,. But S,, the dependent set of M,, consists of 
Pg»P7»P,3 and hence S,, the augmented dependent set of M,, is 
all of ®. Thus the centrality of M, is demonstrated. On the other 
hand, we may see in precisely the same manner that M, is not 
central; S, consists of the outputs p,,p,,e, while S, consists of 
the outputs p,,(4,03:P¢,P7,P,+ Hence the complementary sub- 
system of M, is just {M,,M,,M,,M,}. The reader may find it 
helpful to compute these structures for the other components of 
the system and to construct similar examples of his own. 

Several general results which follow almost immediately from 
the definitions of the concepts involved are also quickly verified 
in the special case of Figure 2. For example, we have for each 2, 
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S,¢S,. Further, if M; is a component which can be reached from a 
Peieciant M; along a aiceuiad path, then 8, C 8. 

We are now in a position to inquire into cee properties of (M,R)~ 
systems which may be of biological interest. In particular, we de- 
sire to investigate what we shall term the re-establishment of in- 
hibited components. If we reflect for a moment on the structures 
which we have defined, we are led to the following definition of 
this concept: a component M, of an (M,R)~system will be said to be 
re-establishable if and only if the condition 8,9 S, = @ holds. In 
words, if a component M, of an (M,R)~system is inhibited or de- 
stroyed, then it can be replaced, or re-established, by the system 
if and only if no output in the augmented dependent set S, of M, 
serves as input to the system #, which corresponds to the com- 
ponent M,. It will be readily seen that such matters may be of 
considerable importance in biological applications, some of which 
we now proceed to investigate. 

We may list here a number of results which follow immediately 
from the definitions and which may help to clarify the nature of 
what we term re-establishment: 

A component M; of an (M,R)-system is re~establishable if and 
only if it belongs to its related subsystem M?. 

If a component M, of an (M,R)-system is re-establishable, then 

@, 8, = 9 for every component M, from which M, can be reached 
along a directed path. 
These results are too elementary to be listed as theorems or to re- 
quire a formal proof, but the reader may find it helpful to construct 
for himself the diagrams of some hypothetical (M,R)-systems, 
similar to that shown in Figure 2, and see explicitly what are the 
structures we have defined and how they behave. 

We now come to a result of greater interest than the preceding 
and one which indicates what type of results our construction is 
capable of yielding. 

Theorem 2. Given an (M,R)-system in which the graph of M is 
connected, it is impossible for every component of M to be re~ 
establishable. 

Proof. Suppose the theorem false. Then there exists an (M,R)- 
system A in which every component is re~establishable. We re- 
strict our attention to this system. Let M be a terminus of M in 
A; then in particular M is re-establishable. If M were the only 
terminus of M, then only its own outputs are available as inputs to 
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its corresponding F,, which immediately contradicts the re= 
establishability of M. Because of our covering hypothesis, the 
outputs of M must serve as inputs to some F,, The re-establish- 
ability of M precludes their serving as inputs to an F, such that 
the corresponding M, is anterior to M (in the sense that M can be 
reached along a directed path from M,). Hence we conclude that 
there must exist a terminus N of M, which has the property that it 
can be reached along a directed path from a component M, such 
that 8,0 fe is not empty. By hypothesis, N is also re~establish- 
able; hence it follows that no output of N can serve as input to an 
R, such that the associated component M, is anterior to both M and 
N, Once again, if M and N were the only terminals of M, then the 
connectedness of M implies that there exists a component M, from 
which both M and N can be reached along directed paths; this vinlas 
an immediate contradiction and proves the theorem for this case. 
Hence there must exist further terminal components of M. We can 
keep repeating the above argument; since the number of terminals 
of M must be finite, we shall ultimately reach a contradiction. 
This proves the theorem. 


As a corollary of Theorem 2, we obtain a simple existence theorem 
for central components: 

Theorem 3, If an (M,R)=-system (with connected M) has the prop- 
erty that there exists an origin M of M which is not re-establishable, 
while every other component of M is re~establishable, then that 
origin is central for the system. 

Proof. Let us denote the complementary subsystem of the origin 
M by M‘,. Suppose that Mi, were not empty; we shall derive a con- 
tradiction. To every component in M4, let us associate the same 
system #, with which it was associated in M. Then it is readily 
verified that the components in Mj,, together with their associated 
R,, themselves form an (M,R)-system. Our hypothesis states that 
every component of this new system is re-establishable, which 
then contradicts Theorem 2, and our theorem follows. 


If we were to take the (M,R)-systems as models for the metabolic 
activities of the free-living single cell, then Theorems 2 and 3 
would have interesting biological significance. Interpreted as 
such, Theorem 2 asserts that in any metabolizing system there 
must always exist some structure the inhibition or destruction of 
which is not reparable by the system. Theorem 3 is one of a group 
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of theorems which assert that under certain conditions (imposed on 
the system) there exists a biological structure the inhibition or 
destruction of which completely destroys the metabolic activity 
of the system. 

We may make a few general qualitative remarks along these lines. 
First, it is relatively clear that, in an (M,R)-system with the prop- 
erty that the number of outputs of M is small compared with the 
number of components of M, the system will be less likely to be 
able to re-establish injured components in an efficient manner and 
will be more likely to possess central components. Second, the 
more strongly M is connected, the greater the likelihood of the 
existence of central components. For instance, it is clear that if 
a system M of an (M,R)-system contains no subsystems, then it 
must possess central components. No quantitative results in these 
directions have been obtained as yet. 

The concept of re-establishability also may throw some light on 
the apparently irreversible effects which an alteration in environ- 
ment may impart to a metabolizing system. Let us, for example, 
withhold a certain environmental input from an origin M of an (M,R)- 
system. Then in particular all the systems F#, such that Su n 8, # 
® will fail to function. If the environmental input to M is withheld 
for too great a time, the life-times of certain of the corresponding 
components M, will be exceeded. If any of these M, are non-re~ 
establishable, then these components have in effect disappeared 
completely from the system; a restoration of the withheld input 
will not restore these components. However, they may be restored 
by providing the appropriate inputs to the corresponding fF, directly 
from the environment. This particular result should be capable of 
direct experimental check. 

Let us now turn our attention to the part played by the time lag 
structure in the behavior of an (M,R)-system. We shall assume for 
the moment that the operation lags of the components of M are con- 
stant; i.e., independent of the particular inputs to the component. 
Now the notion of finite lifetime of the components of M may be 
stated as follows in precise terms: If a replica of a component M, 
is produced by the corresponding #, at a time ¢,, then this replica 
will cease to function at a time ¢, + u,. Suppose the inputs to 
R, are such that the next replica of M; is produced at time t, + %- 
If v, > u,, then clearly there will be a lag of magnitude U0, — U, in- 
duced in the operation of M, (in effect, we have inhibited the com- 
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ponent M for the time interval v, — u,). This will induce a lag of 
the same magnitude into every output in the dependent set 8, of 
M, as the system continues to operate. In particular, if M; is non~ 
recpatablishable (.e5518, 8: nS, #9), then a further lag of this 
magnitude will be induced s R, and hence back into M,. This 
process will continue untae for as long as the oa ea is in 
operation. If M, is central, then the entire (M,R)=system will suf- 
fer these accumulating lags. The net observable effect of this 
behavior is that the system will take longer and longer to perform 
its operations. In biological terms, we may say that the system 
will ultimately cease to metabolize. 

If we now drop the assumption that the operation lags are con- 
stant for all possible inputs to the components of M and once again 
regard these lags as functions of the particular input objects which 
are provided to the components, then it is possible that there exists 
a set of admissible environmental inputs to the system, which af- 
fect the operation lags of M so as to elicit the behavior described 
above. We may observe that this type of behavior is exhibited by 
a large variety of microorganisms and is typically referred to as 
encystment or ‘‘suspended animation.’” Environments which pro- 
vide inputs capable of eliciting such behavior have actually been 
described for certain protozoa (see Calkins, 1926). The system 
will remain in a state of encystment until the environmental inputs 
to the system allow the lags to attain values which ensure con- 
tinuous operation, and the system will then once again proceed to 
metabolize. 

In conclusion, we may mention a further application of the no- 
tion of time lags, which has not as yet been fully formalized but 
which may be of great importance in drawing conclusions concern- 
ing the morphology of these systems. For simplicity, we assume 
once more that we are given an (M,R)-system all the components of 
which are non-contractible. That is, no component of the system 
produces any output until all of its inputs, as indicated in the graph 
of the system, have arrived at the component. Such a system will 
be seen to function ‘‘optimally,’’ in a certain sense, if the opera- 
tion and transport lags of the system are so adjusted as to mini- 
mize the ‘‘waiting time’’ for inputs at each component. Such con- 
siderations as these fall under the heading of a generalized Prin- 
ciple of Optimal Design (see Rashevsky, 1948; Cohn, 1954, 1955) 
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and may serve as a connecting link between the abstract coarse 
structures which we have considered above and the fine structure 
exhibited by actual physical and biological systems. Among the 
results suggested by a preliminary analysis of these matters is an 
indication that, under certain rather general circumstances, an 
(M,R)-system will function most efficiently if the systems F, are 
localized in space into one or more coherent groups. As such, 
this forms the first theoretical indication of why most metabolizing 
systems possess a nucleus into which its synthetic material is 
gathered. The fact that most cells do possess nuclei is an em- 
pirical biological fact, for which we would like to account on a 
theoretical basis; it is difficult to envisage another type of the- 
oretical structure which could easily yield such a result. 

The few results obtained above should suffice to indicate the 
utility of the notions which we have introduced. Other results fol- 
low from a more rigorous discussion of the general coarse struc- 
ture theory of systems; this will be undertaken in a forthcoming 
paper. Or, we may generalize the concept of (M,R)~system itself; 
certain extensions of these systems lead in the direction of the 
representation of systems which form units of larger (i.e., ‘‘multi- 
cellular’’) metabolizing systems. For such extensions, we may 
drop the restriction we imposed upon the outputs of an (M,R)- 
system, that at least one output from every terminal of M serve as 
input to some &,. Removing this restriction considerably alters 
the centrality and re-establishment properties of the system as a 
whole, and we may hope in this manner to obtain some insight into 
_ the problems we face in the transition to multicellular systems. 


The author is indebted to Professor N. Rashevsky for reading 
and discussing the manuscript. 

This work was aided by United States Public Health Service 
Grant RG-5181. 
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The effect of one judgment upon the next judgment in a discrimination 
Situation is considered to be the result of two types of perseveration. 
One arises from the judgment itself. The other results from a persistence, 
from one trial to the next, of a transient bias. It is shown that the re- 
sulting perseveration can then be a function of the difficulty of the first 
of the pair of choices. Expressions are derived from which the extent of 
each effect can be measured from observed proportions of responses. 


It is the purpose of this note to consider the effect of one judg- 
ment upon the next in terms of two kinds of perseveration. The first 
kind is an effect of the judgment itself and hence is essentially in- 
dependent of the difficulty of the judgment. We shall refer to this 
tendency to give the same response in the next trial as the per- 
severation of response. The second kind of perseveration is that 
which arises due to the possibility that there may be a persistence 
of the fluctuations which cause the distribution of responses, 
These fluctuations can be considered transient biases and so we 
shall refer to this second kind as the perseveration of bias. 

For simplicity we consider that all judgments are of the two- 
category kind and that the second choice is always made from a 
pair of stimuli which, in the absence of perseveration, produce 50% 
of each of the two possible responses. We shall consider only the 
effect of the choice from one pair of stimuli upon a second pair. If 
not, the results are very complex even if only a single type of per- 
severation is considered (Weiss, Coleman and Green, 1955). 

Define the observed perseveration, p, as follows. Let a first 
choice be made in which there is a difference A between the two 
stimuli. We wish to determine how this first judgment influences 
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the choice when a second pair is presented. We suppose that this 
sequence of two judgments has been repeated a number of times. 
Of the responses given to the second pair, let P, be the proportion 
which are the same response as that given to the first pair of stimuli, 
the conditioning pair. Similarly, let P, be the proportion of re 
sponses in which the response is opposite to that of the first pair. 
Then p is defined by 


p=P,-4+=i(P, -P,). (1) 


When P, = 5, p = 0, since the second pair of stimuli were assumed 
to be equivalent. 

It is clear that we can consider only the responses following 
wrong responses to the conditioning pair or we can consider only 
those following correct responses. We therefore can use expres- 
sion (1) to define p, and p,, these being the values of p corre- 
sponding to the above cases. Similarly, we can define p, by ex- 
pression (1) for the case in which we use all responses, wrong or 
right. The quantity p, is the average of p, and p,,, weighted re- 
spectively by the proportions correct and wrong. 

Let p(x) and P (a) be defined as follows: 


p(@) = a ent /2, (2) 
P (2) nf. p(€) ae. (3) 


We make use of the neural mechanism of discrimination previ- 
ously considered (Landahl, 1939). If o is the standard deviation of 
the fluctuating distribution, if 5 = A/o, and if permanent biases 
are ignored or corrected for, we have the following expression for 


P,, the probability of correct response to the first stimulus pair 
(conditioning stimuli): 


Ee Tout deode ele (4) 


Consider next the case in which the first stimulus pair is re- 
sponded to incorrectly, thus having a probability P,. The prob- 
anuLhy that the next response is the same P, will be greater than 
= by an amount which depends upon two excitatory effects due re- 
spectively to the two kinds of perseveration. We shall suppose 
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that due to the first kind there is simply an added constant mean 
excitatory effect, ro. 

Let 7 be the fraction of the fluctuation of excitation occurring at 
the time of the first judgment which is still present at the time 
when the second discrimination is made. If the response to the 
first pair is incorrect, the value of this fluctuation could be any 
value less than -oS. The mean value of this fluctuation o¢,, 18 
then given from 


p(0 -$7/2 
fam p-f zp (x) de = ee (5) 


The probability P, of a response to the second pair of equal 
stimuli which is the same response as given to the first is then 
biased by (f¢,, + 7), the sum of the two effects. We now suppose 
that there is superimposed on this bias the same unbiased fluctua- 
tion of standard deviation o which determines P, for all values of 6 
in (4). We then find the value of p_,, the perseveration after a wrong 
response to be given by 


F+f-Cp 
eo [ pada ~1= p(0)(r+fl,)L—-1(r+fC,)2 +061. (6) 


The term expressed as an integral in (6) is P,, the proportion of 
responses which are unchanged. If |r + fé,, | is less than about 
4, only the first two terms should be retained. 

In a similar way we find that after a correct response the per- 
severation p, is given by an expression like (6) but with ¢,, re- 
placed by ¢,. The value ¢, is the mean value of the fluctuations 
resulting in a correct response which have values greater than —o6. 
Hence we obtain 


2 
oo (0) ean /2 
bem pe | er(2)de =. (7) 
e 
ec /-5 c 
Since ¢, and ¢, are known functions of 6 through (5) and (7), 
then p,, and p, are known functions of (r + fC,,) and (r + f¢,) through 
(6) and the corresponding expression obtained from (6) by changing 
the subscript w to c. We may therefore solve for 7 and f in terms of 
p,, and p,. When |r + ie | and |r+ ice | are both less than about 
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$5 the relations are approximately linear so we may express the 
result simply as follows: 


Ls 
— Peale 
pee he P) one : (8) 
P uk, 
ped | eng 
= 9) ere ww (9 
p= PP ) 


Since p, and p,, can be determined as functions of 6 and other ex- 
perimentally controlled parameters, f and r can be determined from 
(8) and (9) as functions of 5 and other parameters. 

Consider next the case in which there is a slight bias which is 
maintained throughout an experiment. Let there be as many trials 
with the bias favoring the correct response in the conditioning judg- 
ment as there are trials in which the bias opposes the correct re- 
sponse. Then it can be shown that to a first approximation we may 
add to the right-hand side of (5) the quantity 


p(0) p(d)«?/P,,. (10) 


This quantity can be estimated from the data on the conditioning 
judgments and subtracted from p,,. Similarly, if p(0) p(8)«?/P, is 
subtracted from the expression for p,, given by (5) by replacing the 
subscripts w by c, then these new values of p, and p,, may be used 
in (8) and (9) to estimate f andr. This procedure has been used to 
estimate f and r from data on lifted weights (Landahl and Birren, 
1959). 

If there are slow systematic variations in bias, the values of p, 
and p,, will be overestimated whenever the period of the experi- 
ment is comparable or larger than the time necessary for change in 
bias. It is only useful to distinguish between perseveration and 
bias if the times involved are quite different. 


This work was aided by a grant from the Dr. Wallace C. and Clara 
A, Abbott Memorial Fund of the University of Chicago. 
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Two somewhat different approaches to topological biology have been 
developed in recent years. The latest, set-theoretical approach leads 
rather immediately to a number of conclusions which are verified experi- 
mentally. It also predicts a number of new biological relations. The 
older, graph-theoretical approach does not lead directly to those con- 
clusions but suggests a number of combinatorial relations between number 
of organs and number of cell types. Such suggestions are absent from 
the set-theoretical approach. It is shown that the above-mentioned 
combinatorial relations are independent of the graph—theoretical method 
proper and can be introduced into the set-theoretical approach through 
the addition of an independent postulate. 

A possible addition to the principle of biotopological mapping is sug- 
gested, which brings into focus the relations between the organism and 
its individual organs and which has a predictive value. 


In a recent paper (Rashevsky, 1958) we discussed a set- 
topological approach to general biology. We reached a number of 
conclusions which are in agreement with well-known facts and 
therefore throw light on the understanding of those facts. Other 
conclusions predict the existence of definite experimentally veri- 
fiable relations. 

In preceding papers (Rashevsky, 1954; 1955a,b,c; 1956a,b) we 
discussed a combinatorial or graph-theoretical approach. Although 
we pointed out in the preceding paper (Rashevsky, 1958) that cer- 
tain graphs are associated with the topological spaces used there, 
yet the two approaches seem to be different in many respects. The 
combinatorial approach leads also to the prediction of various rela- 
tions within organisms which are outside of the scope of metric 
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mathematical biology. Yet those relations, such as the relation 
between the number of cell types and the number of organs, are 
less specific. They depend on additional hypotheses. The set- 
theoretical approach leads us directly, for example, to such con- 
clusions as that emotional disturbances should result in gastro- 
intestinal or cardiovascular disturbances. The combinatorial ap- 
proach does not lead us to any of those conclusions. On the other 
hand, the set-theoretical approach does not seem to have any room 
for considerations of relations between number of organs and num- 
ber of cell types nor for other relations discussed in the preceding 
paper (Rashevsky, 1958). 

First of all we may remark that the set-theoretical approach as 
given in that preceeding paper (Rashevsky, 1958) may be some- 
what generalized. In considering rule A of that paper, we may as- 
sign in any arbitrary manner relations of immediate precedence or 
succession for any subsets P,,, of a basic set of properties P,. It 
seems natural to assume that the more inclusive subsets will pre- 
cede the less inclusive. Thus if P,,,C P,,, then P;, — Pig, 
This, however, is not necessary. No matter how we assume the 
relation of succession or precedence for the subsets P;, for a con- 
stant z but for different «’s, we still shall have a continuous 
mapping, if we define the neighborhoods as we did. 

An examination of the two approaches shows that tnis apparent 
deficiency of the otherwise more general and apparently more power- 
ful set-theoretical approach lies in the circumstance that in our 
combinatorial approach the combinatoric proper and the topology 
are essentially independent of each other. Thus the equation (1) 
of a previous paper (Rashevsky, 1955c) holds not only for 7%, but 
for any (7X), (¢ = 1,2,...,14). Yet certain topological aspects 
of these different (7? X) are different. 

This remark makes it possible to incorporate some of the as- 
pects of the graph-theoretical approach into the set-theoretical 
one. Such an incorporation means a restriction on some of the pos- 
sibilities offered by the set-theoretical approach. But this is per- 
haps just what we want. As pointed out in the preceding paper 
(Rashevsky, 1958), the spaces S, discussed there may be too gen- 
eral and a restrictive additional assumption may be needed. As 
long as this additional assumption does not invalidate the useful 
conclusions drawn from the set-theoretical approach, it may prove 
itself to be useful. 
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The argument which leads to equation (1) of Rashevsky (1955c), 
namely, 


r=m+n(m-—1), (1) 


can be used almost without change in the set~theoretical approach. 
Instead of assigning to each property P, in Sp any arbitrary set of 
subproperties P, , in S,, we now proceed as follows. 

Consider an aggregate of identical cells, each possessing all 
the basic properties P,. Let n be the number of the basic proper- 
ties P,. Divide the aggregate into m aggregates. Let the cells of 
the rth aggregate specialize in n, particular properties of the n 
basic properties and lose the n — n, remaining ones. We again have 


n 


nF: oat (2) 


r=i 


We now can make one of the following assumptions: 

a) When an aggregate loses n-—n, basic biological properties 
P,, then n—n, new aggregates are formed, each of which has ac- 
quired some subproperty P;,, of one of the non-lost basic properties 
P,. We shall call those additional aggregates ‘‘subsidiary aggre- 
gates.’” The n—n, subproperties P,, are all different. In other 
words we have altogether n —n, subproperties P,,, 4 =1,2,..., 
n-N,. 

b) When an aggregate loses n — n, basic biological properties P, , 
then n-7n, new subsidiary aggregates are formed, each of which 
acquires a subproperty P;, of any of the basic properties P,, 
whether lost or retained by the rth aggregate. The n-n, sub- 
properties P,,, are all different. 

The number of subproperties which thus appear as a result of 
the assumed specialization for any of the m subaggregates isn —n,. 
Therefore the total number of subproperties is equal, because of 
(2), to: 


a (n-—n,) =n(m-—1). (3) 


r=1 


This is also the number of subsidiary aggregates. If we add to 
them the original m aggregates, we obtain for the total number of 
different aggregates or cell types the expression (1). If now we 
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identify m with the number of organs, we can interpret (1) in the 
game manner as we did in the preceding paper (Rashevsky, 1958). 

The different subproperties P,, are related to the subproperties 
P,, in the space S,, according to rule A of the previous paper (Ra- 
shevsky, 1958). We thus obtain a subset of the set of all possible 
spaces S,. While, as we have seen, the set of all spaces S, may 
be infinite, yet by the same argument as before we see that the 
subset of this set of all possible spaces S, is finite. In other 
words, with either assumption a) or assumption b), the total number 
of possible organisms is finite. This total number depends on n, 
the number of basic specializable properties in S,. Yet for a given Sp 
this number is in general not equal to the number of possible or- 
ganisms in (P“X), (¢ =1,2,...,14), where P is the primordial 
graph which is associated with S., The reason for this is that we 
have not considered here the possible distributions of the sub- 
properties P,, among the different P;. Thus the counterparts of 
operations 7'{ and TS, (i = 1,2,...,14), are missing in the as- 
sumptions a) and b). An introduction of corresponding additional 
assumptions will mean a further restriction on S,. 

Since the set S of all possible spaces thus obtained is a subset 
of the set S, of all possible spaces S, discussed previously (Ra- 
shevsky, 1958), therefore all conclusions drawn there remain valid. 

Assumption b) is biologically much more realistic than assump- 
tion a). According to the latter, an organ would consist only of 
cell types which specialize in one or a few basic properties P; and 
in the subproperties P,, of those properties. Actually this is not 
so. The eye, organ of vision, consists not only of cells which 
specialize in photosensitivity to light of different wave-lengths. 
It consists also of different types of muscles, secretory cells, etc. 
The same holds for other organs. Assumption b) added to the postu- 
lates of a previous paper (Rashevsky, 1958) divides all the sub- 
properties P,, of the organism or all of the points P,, of S, into 
groups of subproperties which ‘‘belong together’’ by virtue of their 
construction through assumption b), They may be considered as 
belonging together also by virtue of performing a common compli- 
cated biological function. Thus if the rth aggregate of cells spe- 
cializes in the property P, of sensitivity to external stimuli, then 
the subsidiary aggregate with the subproperties Py of different 
orderly movements will represent muscles which serve in the 
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process of vision, e.g., eye muscles, ciliary muscle, etc. We 
may introduce the following explicit assumption: 

c) The cell types which are characterized by the subproperties 
P,;,, and which correspond to a given rth aggregate of the original 
m aggregates are all segregated spatially in an organism and con- 
stitute an organ. 

From a postulational point of view the above may be regarded 
not as an assumption but as a definition of an organ. 

The above considerations suggest another interesting possibility. 

As already remarked every organ has subproperties of most of 
the basic biological properties. A gland does not have any muscular 
elements. But it certainly exhibits some subproperties of the mo- 
lecular orderly movements P, While a gland does not possess 
sensitivity to direct eal al it can be stimulated endo- 
genically. All organs receive food from the blood which is part of 
the circulatory system of the organism as a whole. Blood is the 
‘‘milieu interieur’’ of the organism. It is, however, an external 
medium for the cells which constitute the different organs. Tenta- 
tively we may consider the following postulate which may be in- 
corporated into the system of postulates given in the preceding paper 
(Rashevsky, 1958). 

Postulate. Each individual organ can be mapped continuously 
on S, and the organism as a whole can be mapped continuously on 
each of its organs. 

Certain interesting conclusions follow almost immediately from 
this postulate. In S$, an external stimulus results in molar or mo- 
lecular orderly movements which in their turn result in an uptake of 
food from the environment. In a gland the orderly movements are 
of the molecular type and represent either secretions or uptake of 
substances from the blood which now plays the role of the external 
environment. Hence, proper stimulation of a gland should result 
directly in a higher uptake of food substances from the blood. 
Stimulation of the eye by light should also result directly in a higher 
absorption of food from the blood. The mechanism of this may be 
manifold: a vasodilation which results in an increased blood flow 
through the organ, an increase of permeability of some cells, etc. 
Similar conclusions follow about any other organ. Those conclu- 
sions may sound trivial, but they are by no means self-evident 
truths, 
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Another interesting conclusion is the following. The organism 
as a whole picks up food from the environment. In the digestive 
mechanism that food is split into parts that are useful to the or- 
ganism and are absorbed by it and into parts that are rejected, be- 
ing of no use to the organism. According to our postulate a situa- 
tion relationally isomorphic to this should be found in individual 
organs. The food which a cell of an organ takes from the blood is 
very different from the ‘‘raw’ food which the organism takes from 
its environment. It is already digested and no intracellular diges- 
tion takes place in organs of the higher organisms. Yet a relational 
isomorphism with the phenomenon of digestion must be present if 
the organism can be mapped on the organ. The basic relational 
feature of digestion, quite regardless of any particular biochemical 
mechanism involved, consists of a substance A being taken up, 
split in two or more substances A,, A,,...,A4,, of which some are 
retained, some excreted back. We should therefore expect that re- 
actions of that type will occur in any organ even with the sub- 
stances which are already digested in the ordinary sense and which 
are present in the blood. That every cell of an organ takes in 
different substances from the blood and returns other substances 
to the blood is, of course, a generally known phenomenon. But our 
postulate requires that among the excreted substances there must 
be some which are fragments of the substances that have been 
taken in. This in principle is an experimentally verifiable state- 
ment. 

The above-discussed postulate is independent of the principle 
of biotopological mapping. It may, if necessary, be added to it. 
There is, however, one conclusion which does follow from the gen- 
eral principle. 

Consider any biochemical chain of reactions, for example, the 
reaction of sugar metabolism. Such a reaction is represented by a 
directed graph. Or, if we prefer, such a reaction chain may be 
represented by a topological space in which neighborhoods are de- 
fined as before (Rashevsky, 1958). This set of reactions like any 
other biochemical reactions is a part of the organism. The in- 
dividual reactions of the set are particular properties or subproper- 
ties of the organism. Therefore, according to the principle of bio- 
topological mapping, we should expect that the graphs of the corre- 
sponding sets of reactions in different organisms should map con- 
tinuously onto each other. The graphs of the reactions of the higher 
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organisms will be in general more complicated. To each reaction 
of a set in a simpler organism there will correspond several reac- 
tions in a higher organism. But a mapping of one set onto another 
should be possible with the preservation of the basic biochemical 
relations. 


This work was aided by United States Public Health Service 
Grant RG-5181. 
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In a recent paper (Bull. Math. Biophysics, 20, 245, 1958), Robert 
Rosen applied topological considerations to the stay of an organism as 
a whole. Those considerations have no direct relation to the principle 
of biotopological mapping. They rather represent a topological model of 
an organism, especially a model of the repair mechanisms which or- 
ganisms possess for lost or impaired parts. In this note it is shown that 
the model introduced by Rosen may possibly be derived from the principle 
of biotopological mapping plus a proper definition of the primordial. Such 
a derivation may also provide a clue to a proper biotopological approach 
to the problem of multiplication of organisms. 


In an interesting paper, published in this issue of the Bulletin, 
Robert Rosen (1958) outlined a novel topological approach to the 
theory of the organism. He defines the so-called (M, R)-systems in 
which certain components, the K-components, play the role of re- 
pair mechanisms for the other components, the M-components. 
Rosen proves a number of important theorems about such systems. 
Familiarity with his work is presupposed for the understanding of 
the following argument. 

A somewhat weak point of Rosen’s theory is the question as to 
what happens when an #,-component is destroyed. Does it become 
re-established and if so, how? Or are the &;-components not re~ 
establishable? In the latter case we have a biologically somewhat 
unlikely situation. Catabolic processes must take place also in 
the R,-components. Therefore after a while those components will 
cease to exist and the M,;-components will become not re~establish- 
able. On the other at if for some reason or other the life span 
of the 2,-components is much greater than that of the M,~compo- 
nents, in other words if they decay much more slowly, ‘then the 
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above situation may not appear to be quite so unlikely. We may 
perhaps associate some phenomena of aging with the decay of the 
R,-components, inasmuch as it is known that with age the self- 
repairing ability of an organism in general decreases. 

However, it would seem decidedly desirable to investigate dif- 
ferent possibilities, namely, such where a re-establishment of the 
F,-components takes place. The most interesting of such possi- 
bilities is to consider that some M, system or several of them may 
play the role of R-systems with respect to some #,-systems. This 
will impose certain conditions on the whole (M, R)-system, and the 
study of the resulting possibilities is likely to offer a fertile field 
for biotopological investigations. 

Another possibility, which is probably the simplest one, is to 
assume that an & -component, if destroyed, becomes re-established 
automatically as long as the corresponding set 6, of environmental 
outputs of M remains intact. 

Regardless of the above, a very interesting aspect of Rosen’s 
(M, R)-systems is that they may offer a clue to a possible bio- 
topological treatment of the problem of reproduction. Hitherto in 
all our previous publications we considered reproduction just as 
another basic biological property, on par with any other property 
P,. Yet somehow this seems to be inadequate, because reproduc- 
tion seems to occupy a central position among the other properties. 
Reproduction causes the spread of life on earth, and all other 
biological activities of the organism seem to converge towards 
that result, 

The theory of the (M, R)-systems has no connection with the 
principle of biotopological mapping. It is basically a topological 
model of the organism. Inasmuch as our aim is to discover funda- 
mental general principles in biology, we should attempt to reduce 
any models, topological or otherwise, to the general principles. 
We shall now very tentatively suggest a possibility of deriving the 
(M, R)-systems from the principle of biotopological mapping com- 
bined with a proper definition of the primordial. 

We already indicated (Rashevsky, 1958a) that the primordial or- 
ganism may not be an actually existing one. We may go now a step 
further and say that the primordial need not be even an organism 
that ever existed. For our purposes it may perfectly well be an 
abstraction, defined as the smallest set of basic properties which 
still would be considered as an organism. According to a previous 
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paper (Rashevsky, 1958a) a basic property P, is the logically most in- 
clusive set of all subproperties P..,. If we apply this point of view, 
then we can considerably reduce the cardinal number of the set of 
basic properties of a primordial. Essentially, as we already re- 
marked elsewhere (Rashevsky, 1955, 1956b), the many properties 
of an organism are logically different aspects of selection. An or- 
ganism, through its sense organs, selects the proper location and 
proper character of its food. Through either molar (Rashevsky, 
1958a) or molecular movements P, it continues the selection of the 
proper food. The digestive enzymes act selectively on certain sub- 
stances and break them down in a selective manner. Thus the idea 
is naturally suggested to consider all the above-mentioned basic 
properties as subproperties of the more inclusive property P_,, of 
selection. Some of the subproperties and therefore P_,, itself would 
be inputs into the primordial, some—outputs. The next set of 
properties all deal with metabolic activities and may perhaps be 
all considered as subproperties of another basic property P, which 
can be denoted as transformation. This transformation includes 
both production of enzymes and of waste products, and the proper 
arrangement of the selected molecules, obtained as a result of the 
operation of property P..,, into a new organism. In line with Robert 
Rosen’s views (1958), we shall consider the property P, neither as 
input nor as output, but as a mapping of outputs on inputs, or as 
relations between inputs and outputs. 

In line with this view the simplest organism recognizable as such 
would consist of two components. One, M, will have as outputs 
certain enzymes or enzymatic properties connected with the or- 
ganism directly (if the organism consists of only one molecule). 
The effect of this output would be to produce by selection from the 
fragments of food, a set of molecules which can be used as build- 
ing stones for the organism. The second component, F, would take 
those in as inputs and produce as output through synthetic proc- 
esses a lew organism. 

The graph representing such an organism would be a simple 
open-branched structure with an additional environmental input 
into M and an output from M, as shown in Figure 1. 

We may remark that a virus molecule is not too dissimilar from 
the above scheme. The virus must either act directly as lytic 
agent on the cytoplasm of the host or send off small catalytic 
particles to do that. Its selectivity is well known. Once the build- 
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ing stones are obtained by lysis, the replication mechanism, pre- 
sumably DNA, produces other virus molecules. 


M 
R 
E ee 
Replication 
of (M,R) 
FIGURE 1 


If we now apply either transformation rule A of the preceding 
paper (Rashevsky, 1958a) in its generalized form (Rashevsky, 1958b) 
or the rules T™ (uw = 1,+.., 14) discussed still earlier (Rashevsky, 
1956b) to the primordial which we just suggested, we can obtain 
very complex structures. Formally the above transformation rules 
can be applied to an (M, R)-system, for it does not make any dif- 
ference topologically whether the points represent biological prop- 
erties or components. Instead of one output of M in the primordial, 
there will be now a number of ‘‘suboutputs,’’ in which different 
components M, will be specialized. The same holds about R. In 
effect we obtain an (M, R)-system. 

Such an (M, R)-system differs, however, from the one introduced 
by Rosen, and discussed above, in one very essential feature: The 
components M, are not merely repaired, but they multiply. There 
is, however, a close relation between repair of parts of an organism 
and the multiplication of its constituent cells. Multiplication does 
not occur, however, unless repair is needed. An explanation of 
this situation may lie in an assumption which we already made 
elsewhere (Rashevsky, 1948, Chapter XVIII) and which is almost 
inescapable, if we are to account for the cessation of growth of the 
whole organism after a certain time and yet understand the po- 
tentially unlimited cell multiplication which will go on in an ex- 
cised piece of tissue of such an organism if the tissue is placed in 
a proper medium. We must assume that the different cells of an 
organism exert some kind of mutual inhibition on each other and 
that when the number of cells in the organ reaches a certain limit 
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the inhibition becomes complete. The situation is formally not 
unlike that of mutually inhibiting neurons. When there are too many 
of them, the inhibition is complete. 

With such an assumption, which may possibly eventually become 
a general principle, the (M, R)-system, obtained by a biotopologi- 
cal transformation from a proper primordial will behave just as 
discussed by R. Rosen (1958). 

We now run, however, into another difficulty. The primordial re- 
produces itself, but the (M, R)-system obtained from it by a bio- 
topological transformation only repairs its parts. 

The solution of this difficulty is likely to lie in an extension or 
sharpening of the principle of biotopological mapping, to which we 
already alluded (Rashevsky, 1954). A complex higher organism is 
not obtained from a simple one by a single transformation but 
through a series of steps. The rule A of the previous paper (Ra- 
shevsky, 1958a) and the rules T™ (wu =1,...,14) presented else- 
where (Rashevsky, 1956b) give us the end result of the transforma- 
tion. They do not tell anything about the steps in which it proceeds 
and which correspond to the steps of both phylogenetic and onto- 
genetic development. In ontogenesis an organism does not develop 
from a primordial but from an already rather complex, though uni- 
cellular, organism, the ovum. This does not contradict the princi- 
ple of biotopological mapping, because if a simpler and a more 
complex organism both map continuously onto a primordial, then 
the more complex will map onto the simpler one. Hence we can 
introduce into the topological space or graph of an organism a sub- 
space or partial graph, 0, which represents the ovum, and from 
which the whole organism develops in successive steps. In terms 
of the (M, R)-system, O would be a subsystem. If we now assume 
that the subsystem 0 is the only one that is not inhibited, then all 
other components and subsystems will merely be re-established, 
while O will from time to time multiply and reproduce the whole 
organism. 

As to the steps of the transformation from the representative 
space S, of a primordial to the representative space S, of a com- 
plex organism, the most natural and simple thing to consider is 
that at first the more inclusive subproperties P,, develop and 
later the less inclusive ones. Thus if P,,,C P,,, then P,, will 
develop first. Since (Rashevsky, 1958a) any choice of Fe a 18 
permissible, several different situations are possible. We may have 
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a series of organisms of increasing complexity, such that the set 
Sik of all subproperties of the more complex one includes the set 
S, of the less complex one, thus S, c $,,,. Such a linear arrange- 
ment will, however, be a rather special one. More generally we 
shall find that for two organisms, 7 and &, of either the same or of 
different complexities 


S,9S, 49; S$, S.4#S; S,US, ¢S,; (1) 


which means that S, and S, have elements in common but neither is 
included in the other. The point at which the above relation holds 
may be reached at a certain degree of complexity prior to which 
the consecutive S.’s are included in each subsequent one. With in- 
creasing complexity, the cardinal number of the intersection $,9 §, 
may become smaller, and finally S$, and S$, may even become dis- 
joined. They will both contain subproperties of the same basic 
properties P,, but different subproperties. 

A development of this type is not representable by a linear series 
or by a line. It corresponds to a branched tree, just as is the case 
in actual evolution. 


This work was aided by United States Public Health Service 
Grant RG-5181. 
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